Sep 28 14:51:25 devstack cinder-volume[75717]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:51:25 devstack cinder-volume[75717]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:51:25 devstack cinder-volume[75717]: we strongly recommend against using it for new projects. Sep 28 14:51:25 devstack cinder-volume[75717]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:51:25 devstack cinder-volume[75717]: framework. For more detail see Sep 28 14:51:25 devstack cinder-volume[75717]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:51:25 devstack cinder-volume[75717]: import eventlet # noqa Sep 28 14:51:27 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:27 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:27 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:28 devstack cinder-volume[75717]: INFO dbcounter [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Registered counter for database cinder Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG oslo_db.sqlalchemy.engines [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writer thread running {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:51:29 devstack cinder-volume[75717]: INFO cinder.rpc [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:51:29 devstack cinder-volume[75717]: INFO cinder.rpc [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG oslo_db.sqlalchemy.engines [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:29 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Determined volume DB was empty at startup. Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75717) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:51:29 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:51:29 devstack cinder-volume[75717]: WARNING stevedore.named [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:51:29 devstack cinder-volume[75717]: WARNING castellan.key_manager [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:29 devstack cinder-volume[75717]: WARNING cinder.keymgr.conf_key_mgr [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75717) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:29 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.411s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_db.sqlalchemy.engines [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:30 devstack cinder-volume[75717]: INFO cinder.rpc [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 14:51:30 devstack cinder-volume[75717]: INFO cinder.rpc [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 14:51:30 devstack cinder-volume[75717]: WARNING stevedore.named [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:51:30 devstack cinder-volume[75717]: WARNING castellan.key_manager [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:30 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_db.sqlalchemy.engines [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:30 devstack cinder-volume[75717]: INFO oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Starting 1 workers Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Started child 75865 {{(pid=75717) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Full set of CONF: {{(pid=75717) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] ******************************************************************************** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Configuration options gathered from: {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] ================================================================================ {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] allow_availability_zone_fallback = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] allow_compression_on_image_upload = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] allowed_direct_url_schemes = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] api_rate_limit = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] auth_strategy = keystone {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] az_cache_duration = 3600 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_availability_zone = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_host = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_stats_polling_interval = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backup_api_class = cinder.backup.api.API {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backup_name_template = backup-%s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backup_use_same_host = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backup_use_temp_snapshot = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] chap_password = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] chap_username = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75865]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_internal_tenant_project_id = 13ead81f9d7a463a97bbe96d8bebe424 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_internal_tenant_user_id = 1573710077bb4ff7abc365a2660dd7d1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cloned_volume_same_az = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cluster = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] compression_format = gzip {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] compute_api_class = cinder.compute.nova.API {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] config_dir = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] config_source = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] control_exchange = openstack {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] debug = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] default_availability_zone = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] default_group_type = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] default_volume_type = lvmdriver-1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] disk_geometry = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] driver_client_cert = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] driver_client_cert_key = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] driver_data_namespace = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] driver_ssl_cert_path = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] driver_ssl_cert_verify = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] driver_use_ssl = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] enable_force_upload = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] enable_new_services = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] enable_unsupported_driver = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] enforce_multipath_for_image_xfer = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] filter_function = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_api_insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_api_ssl_compression = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_ca_certificates_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_catalog_info = image:glance:publicURL {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_num_retries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance_request_timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] goodness_function = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] graceful_shutdown_timeout = 5 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] group_api_class = cinder.group.api.API {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] host = devstack {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_compress_on_upload = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_conversion_address_space_limit = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_conversion_cpu_limit = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_conversion_disable = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_upload_use_cinder_backend = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_upload_use_internal_tenant = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_volume_cache_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_volume_cache_max_count = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] image_volume_cache_max_size_gb = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] init_host_max_objects_retrieval = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] instance_format = [instance: %(uuid)s] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] iscsi_target_flags = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] iscsi_write_cache = on {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] iser_helper = tgtadm {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] iser_ip_address = 192.168.122.31 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] iser_port = 3260 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_color = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_config_append = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_dir = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_options = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_rotate_interval = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_rotate_interval_type = days {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] log_rotation_type = none {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] max_age = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] max_logfile_count = 30 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] max_logfile_size_mb = 200 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] max_over_subscription_ratio = 20.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] message_reap_interval = 86400 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] message_ttl = 2592000 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] migration_create_volume_timeout_secs = 300 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] monkey_patch = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] monkey_patch_modules = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] my_ip = 192.168.122.31 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] no_snapshot_gb_quota = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] num_iser_scan_tries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] num_shell_tries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] num_volume_device_scan_tries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] nvmeof_conn_info_version = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] nvmet_ns_id = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] nvmet_port_id = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_max_limit = 1000 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_volume_ext_list = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_volume_listen_port = 8776 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_volume_use_ssl = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] osapi_volume_workers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] per_volume_size_limit = -1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] periodic_fuzzy_delay = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] periodic_interval = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] public_endpoint = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] publish_errors = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_backup_gigabytes = 1000 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_backups = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_gigabytes = 1000 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_groups = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_snapshots = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] quota_volumes = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] rate_limit_burst = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] rate_limit_except_level = CRITICAL {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] rate_limit_interval = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] reinit_driver_count = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] replication_device = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] report_discard_supported = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] report_interval = 120 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] reservation_clean_interval = 86400 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] reservation_expire = 86400 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] reserved_image_namespaces = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] reserved_percentage = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] rpc_response_timeout = 120 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] run_external_periodic_tasks = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75865]: INFO cinder.volume.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] scst_target_driver = iscsi {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] scst_target_iqn_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_down_time = 720 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] shell_completion = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] snapshot_name_template = snapshot-%s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] snapshot_same_host = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] split_loggers = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] state_path = /opt/stack/data/cinder {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] storage_availability_zone = nova {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] storage_protocol = iSCSI {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] syslog_log_facility = LOG_USER {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] target_helper = lioadm {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] target_ip_address = 192.168.122.31 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] target_port = 3260 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] target_protocol = iscsi {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] target_secondary_ip_addresses = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] trace_flags = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] transport_url = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] until_refresh = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_chap_auth = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_default_quota_class = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_journal = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_json = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_multipath_for_image_xfer = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_stderr = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] use_syslog = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] verify_glance_signatures = enabled {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_api_class = cinder.volume.api.API {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_backend_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_clear = zero {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_clear_ionice = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_clear_size = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_copy_bps_limit = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_dd_blocksize = 1M {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_name_template = volume-%s {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_service_inithost_offload = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volume_usage_audit_period = month {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] zoning_mode = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.auth_section = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.auth_type = password {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.auth_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.cache = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.include_service_catalog = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.interface = public {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_password = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcache_username = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.region_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.service_type = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.backend = dogpile.cache.null {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.backend_argument = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.backend_expiration_time = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.config_prefix = cache.oslo {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.debug_cache_backend = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.enable_retry_client = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.enable_socket_keepalive = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.expiration_time = 600 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_dead_retry = 300 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_pool_maxsize = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_sasl_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.password = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.proxies = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.redis_db = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.redis_server = localhost:6379 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.retry_attempts = 2 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.retry_delay = 0.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.socket_keepalive_count = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.socket_keepalive_idle = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.socket_keepalive_interval = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.socket_timeout = 1.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.tls_allowed_ciphers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.tls_cafile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.tls_certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.tls_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.tls_keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cache.username = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] coordination.backend_url = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.asyncio_connection = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.asyncio_slave_connection = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.backend = sqlalchemy {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.connection = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.connection_debug = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.connection_parameters = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.connection_recycle_time = 3600 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.connection_trace = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.db_inc_retry_interval = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.db_max_retries = 20 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.db_max_retry_interval = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.db_retry_interval = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.max_overflow = 50 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.max_pool_size = 5 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.max_retries = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.pool_timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.retry_interval = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.slave_connection = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.sqlite_synchronous = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.synchronous_reader = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] database.use_db_reconnect = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_tracing.insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.connection_string = messaging:// {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.es_doc_type = notification {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.es_scroll_size = 10000 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.es_scroll_time = 2m {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.filter_error_trace = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.hmac_keys = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.sentinel_service_name = mymaster {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.socket_timeout = 0.1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.trace_requests = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler.trace_sqlalchemy = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler_jaeger.process_tags = {} {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] profiler_otlp.service_name_prefix = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.enforce_new_defaults = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.policy_default_rule = default {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.policy_file = policy.yaml {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.group = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.helper_command = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] privsep_osbrick.user = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.group = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.helper_command = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] cinder_sys_admin.user = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.auth_section = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.auth_type = password {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.cafile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.collect_timing = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.send_service_user_token = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.split_loggers = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.tls_ciphers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] service_user.tls_min_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.auth_section = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.auth_type = password {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.collect_timing = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.region_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.split_loggers = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.tls_ciphers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] glance.tls_min_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.backend_availability_zone = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.chap_password = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.chap_username = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.disk_geometry = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.driver_client_cert = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.driver_client_cert_key = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.driver_data_namespace = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.driver_use_ssl = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.extra_capabilities = {} {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.filter_function = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.goodness_function = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.iscsi_target_flags = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.iscsi_write_cache = on {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.iser_helper = tgtadm {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.iser_port = 3260 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.lvm_share_target = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.lvm_type = auto {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.num_shell_tries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.replication_device = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.report_discard_supported = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.reserved_percentage = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.target_helper = tgtadm {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.target_port = 3260 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.target_protocol = iscsi {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.trace_flags = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.unique_fqdn_network = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.use_chap_auth = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_backend_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_clear = zero {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_clear_ionice = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_clear_size = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_reports.file_event_handler = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_reports.log_dir = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.backend_host = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.chap_password = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.chap_username = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.disk_geometry = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.driver_client_cert = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.extra_capabilities = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.filter_function = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.goodness_function = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.077s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.iser_helper = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.iser_ip_address = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.iser_port = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.lvm_share_target = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.lvm_type = auto {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.num_shell_tries = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.replication_device = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.report_discard_supported = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.reserved_percentage = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.scst_target_driver = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.storage_protocol = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.target_helper = lioadm {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.target_ip_address = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.target_port = 3260 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.trace_flags = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.use_chap_auth = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_clear = zero {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_clear_size = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] lvmdriver-1.volumes_dir = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_notifications.driver = [] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack sudo[75872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] key_manager.fixed_key = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.barbican_api_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.barbican_endpoint = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.barbican_endpoint_type = public {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.barbican_region_name = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack sudo[75872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.cafile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.collect_timing = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.number_of_retries = 60 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.retry_delay = 1 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.send_service_user_token = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.split_loggers = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.tls_ciphers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.tls_min_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.verify_ssl = True {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican.verify_ssl_path = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.auth_section = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.auth_type = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.cafile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.certfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.collect_timing = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.insecure = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.keyfile = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.split_loggers = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.timeout = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.tls_ciphers = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] barbican_service_user.tls_min_version = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.approle_role_id = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.approle_secret_id = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.auth_method = approle {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.auth_path = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.kv_mountpoint = secret {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.kv_path = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.kv_version = 2 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.namespace = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.root_token_id = **** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.ssl_ca_crt_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.timeout = 60.0 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.token_file = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.token_role = None {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.use_ssl = False {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:30 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] ******************************************************************************** {{(pid=75717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:51:30 devstack sudo[75872]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:30 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:30 devstack sudo[75880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:30 devstack sudo[75880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:31 devstack sudo[75880]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 14:51:31 devstack cinder-volume[75865]: INFO cinder.brick.local_dev.lvm [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:31 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:51:31 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:31 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG cinder.brick.local_dev.lvm [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75865) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 14:51:31 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:31 devstack sudo[76048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:31 devstack sudo[76048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:32 devstack sudo[76048]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.559s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:32 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:32 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:32 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:32 devstack sudo[76336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 14:51:32 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:32 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.419s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:32 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:32 devstack sudo[76516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:51:32 devstack sudo[76516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:33 devstack sudo[76516]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:33 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:33 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:33 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:51:33 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:33 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:33 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:33 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:33 devstack sudo[76604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:33 devstack sudo[76604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:33 devstack sudo[76604]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:33 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:33 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:33 devstack sudo[76607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:33 devstack sudo[76607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:34 devstack sudo[76607]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:34 devstack sudo[76686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:34 devstack sudo[76686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:34 devstack sudo[76686]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:34 devstack cinder-volume[75865]: INFO cinder.volume.drivers.lvm [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:34 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:34 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:34 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:51:34 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:34 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:51:34 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:35 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:35 devstack sudo[76714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:35 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:35 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:35 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:35 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:35 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:35 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:35 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:35 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:35 devstack cinder-volume[75865]: INFO cinder.volume.driver [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:51:35 devstack cinder-volume[75865]: DEBUG cinder.volume.driver [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75865) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG oslo_db.sqlalchemy.engines [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG dbcounter [-] [75865] Writer thread running {{(pid=75865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG cinder.db.api [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Building query based on filter {{(pid=75865) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG cinder.image.image_utils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75865) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 28 14:51:36 devstack cinder-volume[75865]: INFO cinder.keymgr.migration [None req-1e847438-7e1c-4d8f-8d13-1a4662591e50 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:36 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:51:36 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:36 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:36 devstack sudo[76729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:36 devstack sudo[76729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:36 devstack sudo[76729]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:36 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:36 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:36 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:37 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:37 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:37 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:37 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG cinder.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Notifying Schedulers of capabilities ... {{(pid=75865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:51:37 devstack cinder-volume[75865]: INFO cinder.volume.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Driver initialization completed successfully. Sep 28 14:51:37 devstack cinder-volume[75865]: INFO cinder.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Initiating service 2 cleanup Sep 28 14:51:37 devstack cinder-volume[75865]: INFO cinder.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Service 2 cleanup completed. Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG cinder.service [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Creating RPC server for service cinder-volume {{(pid=75865) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG cinder.service [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75865) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:51:37 devstack cinder-volume[75865]: INFO cinder.volume.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:37 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:51:37 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:37 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:37 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:37 devstack sudo[76747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:37 devstack sudo[76747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:38 devstack sudo[76747]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:38 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:38 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:38 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:51:38 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:38 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:38 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:38 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:38 devstack sudo[76753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:51:38 devstack sudo[76753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:38 devstack sudo[76753]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:38 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:38 devstack cinder-volume[75865]: INFO cinder.volume.manager [None req-81a1fb6b-ef57-430d-bad3-32b75df89c88 None None] Driver post RPC initialization completed successfully. Sep 28 14:51:40 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:51:47 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager._thread_info {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:51:47 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread count: 6 {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:51:47 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread info: [<_MainThread(MainThread, started 133995254947968)>, , , , , ] {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:51:48 devstack cinder-volume[75865]: DEBUG dbcounter [-] [75865] Writing DB stats cinder:SELECT=3 {{(pid=75865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:51:48 devstack cinder-volume[75865]: DEBUG dbcounter [-] [75865] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:52:47 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:52:47 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:52:47 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:47 devstack sudo[79003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:52:47 devstack sudo[79003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:48 devstack sudo[79003]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:48 devstack sudo[79006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:48 devstack sudo[79006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:48 devstack sudo[79006]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:48 devstack sudo[79009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:52:48 devstack sudo[79009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:48 devstack sudo[79009]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:48 devstack sudo[79012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:52:48 devstack sudo[79012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:52:48 devstack sudo[79012]: pam_unix(sudo:session): session closed for user root Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG cinder.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Notifying Schedulers of capabilities ... {{(pid=75865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager._thread_info {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread count: 6 {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:52:48 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread info: [<_MainThread(MainThread, started 133995254947968)>, , , , , ] {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:53:47 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:47 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:47 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:47 devstack sudo[82111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:47 devstack sudo[82111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:48 devstack sudo[82111]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:48 devstack sudo[82148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:48 devstack sudo[82148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:48 devstack sudo[82148]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:48 devstack sudo[82151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:48 devstack sudo[82151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:48 devstack sudo[82151]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:48 devstack sudo[82193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:48 devstack sudo[82193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG dbcounter [-] [75865] Writing DB stats cinder:SELECT=1 {{(pid=75865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG dbcounter [-] [75865] Writing DB stats cinder:UPDATE=1 {{(pid=75865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:48 devstack sudo[82193]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:48 devstack cinder-volume[75865]: DEBUG cinder.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Notifying Schedulers of capabilities ... {{(pid=75865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:47 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:47 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:54:47 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:47 devstack sudo[84116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:54:47 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:48 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:48 devstack sudo[84127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:48 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:48 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:48 devstack sudo[84133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:54:48 devstack sudo[84133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:48 devstack sudo[84133]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.336s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:48 devstack sudo[84139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:48 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:49 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:49 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:49 devstack cinder-volume[75865]: DEBUG cinder.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Notifying Schedulers of capabilities ... {{(pid=75865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:49 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager._thread_info {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:49 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread count: 6 {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:54:49 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread info: [<_MainThread(MainThread, started 133995254947968)>, , , , , ] {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:55:47 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:47 devstack cinder-volume[75865]: DEBUG cinder.volume.drivers.lvm [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Updating volume stats {{(pid=75865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:55:47 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:47 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:55:47 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:48 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:48 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:48 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:48 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:48 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:55:48 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:48 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:48 devstack sudo[85685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:48 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG dbcounter [-] [75865] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:48 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_concurrency.processutils [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG cinder.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Notifying Schedulers of capabilities ... {{(pid=75865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG oslo_service.periodic_task [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] Running periodic task VolumeManager._thread_info {{(pid=75865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread count: 6 {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:55:48 devstack cinder-volume[75865]: DEBUG cinder.volume.manager [None req-262591e4-0b97-403c-ac43-46a9b1a4a7b8 None None] thread info: [<_MainThread(MainThread, started 133995254947968)>, , , , , ] {{(pid=75865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:56:10 devstack cinder-volume[75717]: INFO oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Caught SIGTERM, stopping children Sep 28 14:56:10 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Acquiring lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:56:10 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Acquired lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:56:10 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Releasing lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:56:10 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Stop services. {{(pid=75717) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:56:10 devstack cinder-volume[75717]: DEBUG oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Killing children. {{(pid=75717) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:56:10 devstack cinder-volume[75717]: INFO oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Waiting on 1 children to exit Sep 28 14:56:12 devstack cinder-volume[75865]: DEBUG oslo_concurrency.lockutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Acquiring lock "singleton_lock" {{(pid=75865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:56:12 devstack cinder-volume[75865]: DEBUG oslo_concurrency.lockutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Acquired lock "singleton_lock" {{(pid=75865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:56:12 devstack cinder-volume[75865]: DEBUG oslo_concurrency.lockutils [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Releasing lock "singleton_lock" {{(pid=75865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:56:12 devstack cinder-volume[75865]: WARNING amqp [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:56:12 devstack cinder-volume[75865]: WARNING amqp [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:56:12 devstack cinder-volume[75717]: INFO oslo_service.backend._eventlet.service [None req-53c0f1c0-ef3e-4ce1-bfb8-95cfdc5d94c5 None None] Child 75865 exited with status 0 Sep 28 14:56:12 devstack cinder-volume[86205]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:56:12 devstack cinder-volume[86205]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:56:12 devstack cinder-volume[86205]: we strongly recommend against using it for new projects. Sep 28 14:56:12 devstack cinder-volume[86205]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:56:12 devstack cinder-volume[86205]: framework. For more detail see Sep 28 14:56:12 devstack cinder-volume[86205]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:56:12 devstack cinder-volume[86205]: import eventlet # noqa Sep 28 14:56:15 devstack cinder-volume[86205]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:56:15 devstack cinder-volume[86205]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:56:15 devstack cinder-volume[86205]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:56:15 devstack cinder-volume[86205]: INFO dbcounter [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Registered counter for database cinder Sep 28 14:56:15 devstack cinder-volume[86205]: DEBUG oslo_db.sqlalchemy.engines [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG dbcounter [-] [86205] Writer thread running {{(pid=86205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:56:16 devstack cinder-volume[86205]: INFO cinder.rpc [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:56:16 devstack cinder-volume[86205]: INFO cinder.rpc [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_db.sqlalchemy.engines [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:16 devstack cinder-volume[86205]: INFO cinder.volume.manager [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Determined volume DB was empty at startup. Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG cinder.volume.manager [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86205) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:56:16 devstack cinder-volume[86205]: INFO cinder.volume.manager [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:56:16 devstack cinder-volume[86205]: WARNING stevedore.named [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:56:16 devstack cinder-volume[86205]: WARNING castellan.key_manager [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:56:16 devstack cinder-volume[86205]: WARNING cinder.keymgr.conf_key_mgr [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:56:16 devstack cinder-volume[86205]: INFO cinder.volume.manager [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_db.sqlalchemy.engines [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:16 devstack cinder-volume[86205]: INFO oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Starting 1 workers Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Started child 86419 {{(pid=86205) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Full set of CONF: {{(pid=86205) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] ******************************************************************************** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Configuration options gathered from: {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] ================================================================================ {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:56:16 devstack cinder-volume[86419]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] allow_availability_zone_fallback = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] allow_compression_on_image_upload = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] allowed_direct_url_schemes = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] api_rate_limit = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] auth_strategy = keystone {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_availability_zone = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_host = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_stats_polling_interval = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backup_api_class = cinder.backup.api.API {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backup_name_template = backup-%s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backup_use_same_host = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backup_use_temp_snapshot = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] chap_password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] chap_username = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_internal_tenant_project_id = 13ead81f9d7a463a97bbe96d8bebe424 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_internal_tenant_user_id = 1573710077bb4ff7abc365a2660dd7d1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cluster = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] compression_format = gzip {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] compute_api_class = cinder.compute.nova.API {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] config_dir = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] config_source = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] control_exchange = openstack {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] debug = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] default_availability_zone = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] default_group_type = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] default_volume_type = QuobyteHD {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] disk_geometry = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] driver_client_cert = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] driver_client_cert_key = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] driver_data_namespace = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] driver_ssl_cert_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] driver_ssl_cert_verify = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] driver_use_ssl = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] enable_new_services = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] enable_unsupported_driver = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] enabled_backends = ['QuobyteHD'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] enforce_multipath_for_image_xfer = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] filter_function = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_api_insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_api_ssl_compression = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_ca_certificates_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_catalog_info = image:glance:publicURL {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_num_retries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance_request_timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] goodness_function = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] graceful_shutdown_timeout = 5 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] group_api_class = cinder.group.api.API {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] host = devstack {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_compress_on_upload = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_conversion_address_space_limit = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_conversion_cpu_limit = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_conversion_disable = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_upload_use_cinder_backend = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_upload_use_internal_tenant = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_volume_cache_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_volume_cache_max_count = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] image_volume_cache_max_size_gb = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] init_host_max_objects_retrieval = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] instance_format = [instance: %(uuid)s] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] iscsi_target_flags = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] iscsi_write_cache = on {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] iser_helper = tgtadm {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] iser_ip_address = 192.168.122.31 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] iser_port = 3260 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_color = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_config_append = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_dir = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_options = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_rotate_interval = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_rotate_interval_type = days {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86419]: INFO cinder.volume.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Starting volume driver QuobyteDriver (1.1.14) Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] log_rotation_type = none {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.remotefs [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86419) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] max_age = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] max_logfile_count = 30 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] max_logfile_size_mb = 200 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] max_over_subscription_ratio = 20.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] message_reap_interval = 86400 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] message_ttl = 2592000 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] migration_create_volume_timeout_secs = 300 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] monkey_patch = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] monkey_patch_modules = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] my_ip = 192.168.122.31 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] no_snapshot_gb_quota = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] num_iser_scan_tries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] num_shell_tries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] num_volume_device_scan_tries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] nvmeof_conn_info_version = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] nvmet_ns_id = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] nvmet_port_id = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_max_limit = 1000 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_volume_ext_list = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_volume_listen_port = 8776 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_volume_use_ssl = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] osapi_volume_workers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] per_volume_size_limit = -1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] periodic_fuzzy_delay = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] periodic_interval = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] public_endpoint = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] publish_errors = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_backup_gigabytes = 1000 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_backups = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_gigabytes = 1000 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_groups = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_snapshots = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] quota_volumes = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] rate_limit_burst = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] rate_limit_except_level = CRITICAL {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] rate_limit_interval = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] reinit_driver_count = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] replication_device = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] report_discard_supported = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] report_interval = 120 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] reservation_clean_interval = 86400 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] reservation_expire = 86400 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] reserved_image_namespaces = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] reserved_percentage = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] rpc_response_timeout = 120 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] run_external_periodic_tasks = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] scst_target_driver = iscsi {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] scst_target_iqn_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_down_time = 720 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] shell_completion = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] snapshot_name_template = snapshot-%s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] split_loggers = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] state_path = /opt/stack/data/cinder {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] storage_availability_zone = nova {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] storage_protocol = iSCSI {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] syslog_log_facility = LOG_USER {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] target_helper = lioadm {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] target_ip_address = 192.168.122.31 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] target_port = 3260 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] target_protocol = iscsi {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] target_secondary_ip_addresses = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] trace_flags = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] transport_url = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] until_refresh = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_chap_auth = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_default_quota_class = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_journal = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_json = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_multipath_for_image_xfer = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_stderr = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] use_syslog = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] verify_glance_signatures = enabled {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_api_class = cinder.volume.api.API {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_backend_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_clear = zero {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_clear_ionice = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_clear_size = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_copy_bps_limit = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_dd_blocksize = 1M {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_name_template = volume-%s {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_service_inithost_offload = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volume_usage_audit_period = month {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] zoning_mode = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_concurrency.disable_process_locking = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.auth_section = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.auth_type = password {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.auth_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.cache = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86419) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Sep 28 14:56:16 devstack cinder-volume[86419]: WARNING cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:56:16 devstack cinder-volume[86419]: WARNING cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.include_service_catalog = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.interface = public {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Running cmd (subprocess): mount.quobyte {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcache_username = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.region_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.service_type = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.backend = dogpile.cache.null {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.backend_argument = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.backend_expiration_time = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.config_prefix = cache.oslo {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.debug_cache_backend = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.enable_retry_client = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.enable_socket_keepalive = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.expiration_time = 600 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.hashclient_retry_attempts = 2 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_dead_retry = 300 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_pool_maxsize = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_sasl_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.proxies = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.redis_db = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.redis_server = localhost:6379 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.retry_attempts = 2 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.retry_delay = 0.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.socket_keepalive_count = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.socket_keepalive_idle = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.socket_keepalive_interval = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.socket_timeout = 1.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.tls_allowed_ciphers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.tls_cafile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.tls_certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.tls_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.tls_keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cache.username = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] coordination.backend_url = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.asyncio_connection = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.asyncio_slave_connection = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.backend = sqlalchemy {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.connection = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.connection_debug = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.connection_parameters = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.connection_recycle_time = 3600 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.connection_trace = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.db_inc_retry_interval = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.db_max_retries = 20 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.db_max_retry_interval = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.db_retry_interval = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.max_overflow = 50 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.max_pool_size = 5 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.max_retries = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.mysql_wsrep_sync_wait = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.pool_timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.retry_interval = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.slave_connection = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.sqlite_synchronous = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.synchronous_reader = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] database.use_db_reconnect = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_tracing.insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.connection_string = messaging:// {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.es_doc_type = notification {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.es_scroll_size = 10000 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.es_scroll_time = 2m {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.filter_error_trace = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.hmac_keys = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.sentinel_service_name = mymaster {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.socket_timeout = 0.1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.trace_requests = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler.trace_sqlalchemy = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler_jaeger.process_tags = {} {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler_jaeger.service_name_prefix = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] profiler_otlp.service_name_prefix = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.enforce_new_defaults = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.policy_default_rule = default {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.policy_file = policy.yaml {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.group = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.helper_command = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] privsep_osbrick.user = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.group = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.helper_command = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] cinder_sys_admin.user = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.auth_section = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.auth_type = password {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.cafile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.collect_timing = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.send_service_user_token = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.split_loggers = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.tls_ciphers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] service_user.tls_min_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.auth_section = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.auth_type = password {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.collect_timing = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.region_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.split_loggers = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.tls_ciphers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] glance.tls_min_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.backend_availability_zone = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.chap_password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.chap_username = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.disk_geometry = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.driver_client_cert = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.driver_client_cert_key = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.driver_data_namespace = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.driver_use_ssl = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.extra_capabilities = {} {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.filter_function = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.goodness_function = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.iscsi_target_flags = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.iscsi_write_cache = on {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.iser_helper = tgtadm {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.iser_port = 3260 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_host = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_login = admin {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_mount_options = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_private_key = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_share_path = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.num_shell_tries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.quobyte_volume_url = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.replication_device = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.report_discard_supported = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.reserved_percentage = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.target_helper = tgtadm {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.target_port = 3260 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.target_protocol = iscsi {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.trace_flags = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.unique_fqdn_network = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.use_chap_auth = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_backend_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_clear = zero {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_clear_ionice = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_clear_size = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_reports.file_event_handler = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_reports.log_dir = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.backend_availability_zone = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.backend_host = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.chap_password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.chap_username = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.chiscsi_conf = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.disk_geometry = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.driver_client_cert = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.driver_data_namespace = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.driver_use_ssl = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.extra_capabilities = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.filter_function = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.goodness_function = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.iser_helper = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.iser_ip_address = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.iser_port = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.iser_target_prefix = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_host = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_login = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_mount_options = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_password = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_private_key = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_share_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_ssh_port = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] CMD "mount.quobyte" returned: 1 in 0.144s {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86419) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.num_shell_tries = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: INFO cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b ... Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.nvmet_port_id = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 -c /etc/quobyte/client-cinder.cfg {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.replication_device = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.report_discard_supported = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.reserved_percentage = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.scst_target_driver = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.storage_protocol = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.target_helper = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.target_ip_address = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.target_port = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.target_prefix = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.target_protocol = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.trace_flags = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.use_chap_auth = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_clear = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 -c /etc/quobyte/client-cinder.cfg Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_clear_size = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] QuobyteHD.volumes_dir = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_notifications.driver = [] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_notifications.retry = -1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] key_manager.fixed_key = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.barbican_api_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.barbican_endpoint = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.barbican_endpoint_type = public {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.barbican_region_name = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.cafile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.collect_timing = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.number_of_retries = 60 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.retry_delay = 1 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.send_service_user_token = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.split_loggers = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.tls_ciphers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.tls_min_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.verify_ssl = True {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican.verify_ssl_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.auth_section = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.auth_type = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.cafile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.certfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.collect_timing = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.insecure = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.keyfile = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.split_loggers = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.timeout = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.tls_ciphers = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] barbican_service_user.tls_min_version = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.approle_role_id = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.approle_secret_id = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.auth_method = approle {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.auth_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.kv_mountpoint = secret {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.kv_path = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.kv_version = 2 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.namespace = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.root_token_id = **** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.ssl_ca_crt_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.timeout = 60.0 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.token_file = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.token_role = None {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.use_ssl = False {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:16 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] ******************************************************************************** {{(pid=86205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:56:17 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.483s {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:17 devstack cinder-volume[86419]: INFO cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b succeeded Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86419) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.510s {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:17 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:56:17 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:17 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.279s {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:17 devstack cinder-volume[86419]: INFO cinder.volume.driver [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG cinder.volume.driver [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2040061950684, 'free_capacity_gb': 1775.2040061950684, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86419) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_db.sqlalchemy.engines [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG dbcounter [-] [86419] Writer thread running {{(pid=86419) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG cinder.db.api [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Building query based on filter {{(pid=86419) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG cinder.image.image_utils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86419) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 28 14:56:17 devstack cinder-volume[86419]: INFO cinder.keymgr.migration [None req-32ffdfb4-6241-4ce3-9b52-7cc1116bc6cf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86419) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86419) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:17 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:17 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:56:17 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:18 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.543s {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG cinder.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Notifying Schedulers of capabilities ... {{(pid=86419) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:18 devstack cinder-volume[86419]: INFO cinder.volume.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Driver initialization completed successfully. Sep 28 14:56:18 devstack cinder-volume[86419]: INFO cinder.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Initiating service 3 cleanup Sep 28 14:56:18 devstack cinder-volume[86419]: INFO cinder.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Service 3 cleanup completed. Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG cinder.service [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Creating RPC server for service cinder-volume {{(pid=86419) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG cinder.service [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86419) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:56:18 devstack cinder-volume[86419]: INFO cinder.volume.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86419) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG cinder.volume.drivers.quobyte [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86419) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86419) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:18 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:18 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:56:18 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:19 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:19 devstack cinder-volume[86419]: DEBUG oslo_concurrency.processutils [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.615s {{(pid=86419) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:19 devstack cinder-volume[86419]: INFO cinder.volume.manager [None req-83188ad5-be30-4e17-921c-75a4d675e06e None None] Driver post RPC initialization completed successfully. Sep 28 14:56:22 devstack cinder-volume[86205]: INFO oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Caught SIGTERM, stopping children Sep 28 14:56:22 devstack cinder-volume[86205]: DEBUG oslo_concurrency.lockutils [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Acquiring lock "singleton_lock" {{(pid=86205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:56:22 devstack cinder-volume[86205]: DEBUG oslo_concurrency.lockutils [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Acquired lock "singleton_lock" {{(pid=86205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:56:22 devstack cinder-volume[86205]: DEBUG oslo_concurrency.lockutils [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Releasing lock "singleton_lock" {{(pid=86205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:56:22 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Stop services. {{(pid=86205) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:56:22 devstack cinder-volume[86205]: DEBUG oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Killing children. {{(pid=86205) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:56:22 devstack cinder-volume[86205]: INFO oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Waiting on 1 children to exit Sep 28 14:56:23 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Acquiring lock "singleton_lock" {{(pid=86419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:56:23 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Acquired lock "singleton_lock" {{(pid=86419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:56:23 devstack cinder-volume[86419]: DEBUG oslo_concurrency.lockutils [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Releasing lock "singleton_lock" {{(pid=86419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:56:23 devstack cinder-volume[86419]: WARNING amqp [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:56:23 devstack cinder-volume[86419]: WARNING amqp [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:56:23 devstack cinder-volume[86205]: INFO oslo_service.backend._eventlet.service [None req-3c896408-3766-4d2d-b9ab-16b1d63e8286 None None] Child 86419 exited with status 0 Sep 28 14:56:23 devstack cinder-volume[86797]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:56:23 devstack cinder-volume[86797]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:56:23 devstack cinder-volume[86797]: we strongly recommend against using it for new projects. Sep 28 14:56:23 devstack cinder-volume[86797]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:56:23 devstack cinder-volume[86797]: framework. For more detail see Sep 28 14:56:23 devstack cinder-volume[86797]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:56:23 devstack cinder-volume[86797]: import eventlet # noqa Sep 28 14:56:25 devstack cinder-volume[86797]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:56:25 devstack cinder-volume[86797]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:56:25 devstack cinder-volume[86797]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:56:26 devstack cinder-volume[86797]: INFO dbcounter [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Registered counter for database cinder Sep 28 14:56:26 devstack cinder-volume[86797]: DEBUG oslo_db.sqlalchemy.engines [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG dbcounter [-] [86797] Writer thread running {{(pid=86797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:56:27 devstack cinder-volume[86797]: INFO cinder.rpc [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:56:27 devstack cinder-volume[86797]: INFO cinder.rpc [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_db.sqlalchemy.engines [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:27 devstack cinder-volume[86797]: INFO cinder.volume.manager [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Determined volume DB was empty at startup. Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG cinder.volume.manager [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86797) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:56:27 devstack cinder-volume[86797]: WARNING stevedore.named [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:56:27 devstack cinder-volume[86797]: WARNING castellan.key_manager [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:56:27 devstack cinder-volume[86797]: WARNING cinder.keymgr.conf_key_mgr [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:56:27 devstack cinder-volume[86797]: INFO cinder.volume.manager [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_db.sqlalchemy.engines [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:27 devstack cinder-volume[86797]: INFO oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Starting 1 workers Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Started child 86888 {{(pid=86797) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Full set of CONF: {{(pid=86797) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] ******************************************************************************** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] Configuration options gathered from: {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:56:27 devstack cinder-volume[86888]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] ================================================================================ {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] allow_availability_zone_fallback = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] allow_compression_on_image_upload = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] allowed_direct_url_schemes = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] api_rate_limit = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] auth_strategy = keystone {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_availability_zone = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_host = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_stats_polling_interval = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backup_api_class = cinder.backup.api.API {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backup_name_template = backup-%s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backup_use_same_host = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backup_use_temp_snapshot = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] chap_password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] chap_username = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_internal_tenant_project_id = 13ead81f9d7a463a97bbe96d8bebe424 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_internal_tenant_user_id = 1573710077bb4ff7abc365a2660dd7d1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cluster = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] compression_format = gzip {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] config_dir = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] config_source = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] control_exchange = openstack {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] debug = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] default_availability_zone = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] default_group_type = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] default_volume_type = QuobyteHD {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] disk_geometry = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] driver_client_cert = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] driver_client_cert_key = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] driver_data_namespace = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] driver_ssl_cert_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] driver_ssl_cert_verify = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] driver_use_ssl = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] enable_new_services = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] enable_unsupported_driver = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] enforce_multipath_for_image_xfer = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] filter_function = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_api_insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_api_ssl_compression = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_ca_certificates_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_num_retries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance_request_timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] goodness_function = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] graceful_shutdown_timeout = 5 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] group_api_class = cinder.group.api.API {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] host = devstack {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_compress_on_upload = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_conversion_address_space_limit = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_conversion_cpu_limit = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_conversion_disable = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_upload_use_cinder_backend = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_upload_use_internal_tenant = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_volume_cache_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_volume_cache_max_count = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] init_host_max_objects_retrieval = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] instance_format = [instance: %(uuid)s] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] iscsi_target_flags = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] iscsi_write_cache = on {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] iser_helper = tgtadm {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] iser_ip_address = 192.168.122.31 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] iser_port = 3260 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_color = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_config_append = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_dir = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_options = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_rotate_interval = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Starting volume driver QuobyteDriver (1.1.14) Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_rotate_interval_type = days {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] log_rotation_type = none {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] max_age = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] max_logfile_count = 30 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86888) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] max_logfile_size_mb = 200 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] max_over_subscription_ratio = 20.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] message_reap_interval = 86400 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] message_ttl = 2592000 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] monkey_patch = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] monkey_patch_modules = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] my_ip = 192.168.122.31 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] no_snapshot_gb_quota = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] num_iser_scan_tries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] num_shell_tries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] num_volume_device_scan_tries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] nvmeof_conn_info_version = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] nvmet_ns_id = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] nvmet_port_id = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_max_limit = 1000 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_volume_ext_list = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_volume_listen_port = 8776 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_volume_use_ssl = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] osapi_volume_workers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] per_volume_size_limit = -1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] periodic_fuzzy_delay = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] periodic_interval = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] public_endpoint = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] publish_errors = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_backup_gigabytes = 1000 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_backups = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_gigabytes = 1000 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_groups = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_snapshots = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] quota_volumes = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] rate_limit_burst = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] rate_limit_except_level = CRITICAL {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] rate_limit_interval = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] reinit_driver_count = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] replication_device = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] report_discard_supported = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] report_interval = 120 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] reservation_clean_interval = 86400 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] reservation_expire = 86400 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] reserved_image_namespaces = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] reserved_percentage = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] rpc_response_timeout = 120 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] run_external_periodic_tasks = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] scst_target_driver = iscsi {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] scst_target_iqn_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_down_time = 720 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] shell_completion = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] snapshot_name_template = snapshot-%s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] split_loggers = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] state_path = /opt/stack/data/cinder {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] storage_availability_zone = nova {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] storage_protocol = iSCSI {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] syslog_log_facility = LOG_USER {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] target_helper = lioadm {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] target_ip_address = 192.168.122.31 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] target_port = 3260 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] target_protocol = iscsi {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] target_secondary_ip_addresses = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] trace_flags = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] transport_url = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] until_refresh = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_chap_auth = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_default_quota_class = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_journal = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_json = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_multipath_for_image_xfer = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_stderr = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] use_syslog = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] verify_glance_signatures = enabled {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_api_class = cinder.volume.api.API {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_backend_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_clear = zero {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_clear_ionice = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_clear_size = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_copy_bps_limit = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_dd_blocksize = 1M {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_name_template = volume-%s {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_service_inithost_offload = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volume_usage_audit_period = month {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] zoning_mode = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.auth_section = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.auth_type = password {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.auth_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.cache = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.interface = public {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcache_username = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.region_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.service_type = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.backend = dogpile.cache.null {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.backend_argument = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86888) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.backend_expiration_time = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:56:27 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.config_prefix = cache.oslo {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.debug_cache_backend = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.enable_retry_client = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.enable_socket_keepalive = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Running cmd (subprocess): mount.quobyte {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.expiration_time = 600 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_dead_retry = 300 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_sasl_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.proxies = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.redis_db = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.redis_server = localhost:6379 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.retry_attempts = 2 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.retry_delay = 0.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.socket_keepalive_count = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.socket_keepalive_idle = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.socket_keepalive_interval = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.socket_timeout = 1.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.tls_allowed_ciphers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.tls_cafile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.tls_certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.tls_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.tls_keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cache.username = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] coordination.backend_url = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.asyncio_connection = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.asyncio_slave_connection = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.backend = sqlalchemy {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.connection = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.connection_debug = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.connection_parameters = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.connection_recycle_time = 3600 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.connection_trace = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.db_inc_retry_interval = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.db_max_retries = 20 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.db_max_retry_interval = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.db_retry_interval = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.max_overflow = 50 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.max_pool_size = 5 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.max_retries = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.pool_timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.retry_interval = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.slave_connection = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.sqlite_synchronous = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.synchronous_reader = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] database.use_db_reconnect = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_tracing.insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.connection_string = messaging:// {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.es_doc_type = notification {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.es_scroll_size = 10000 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.es_scroll_time = 2m {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.filter_error_trace = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.hmac_keys = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.sentinel_service_name = mymaster {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.socket_timeout = 0.1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.trace_requests = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler.trace_sqlalchemy = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler_jaeger.process_tags = {} {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] profiler_otlp.service_name_prefix = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.policy_default_rule = default {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.group = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.helper_command = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] privsep_osbrick.user = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.group = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.helper_command = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] cinder_sys_admin.user = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.auth_section = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.auth_type = password {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.cafile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.collect_timing = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.send_service_user_token = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.split_loggers = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.tls_ciphers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] service_user.tls_min_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.auth_section = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.auth_type = password {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.collect_timing = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.region_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.split_loggers = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.tls_ciphers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] glance.tls_min_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack quobyte-client[86889]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:56:27 devstack quobyte-client[86889]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.backend_availability_zone = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.chap_password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.chap_username = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.disk_geometry = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.driver_client_cert = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.driver_data_namespace = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.driver_use_ssl = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.extra_capabilities = {} {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.filter_function = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.goodness_function = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.iscsi_target_flags = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.iser_port = 3260 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_host = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_login = admin {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_mount_options = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_private_key = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_share_path = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.replication_device = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.report_discard_supported = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.target_helper = tgtadm {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.target_port = 3260 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.target_protocol = iscsi {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.trace_flags = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.use_chap_auth = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_backend_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_clear = zero {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_reports.file_event_handler = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_reports.log_dir = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.backend_host = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.chap_password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.chap_username = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.disk_geometry = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.driver_client_cert = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.extra_capabilities = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.filter_function = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.goodness_function = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.iser_helper = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.iser_ip_address = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.iser_port = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_host = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_login = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_mount_options = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_password = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_private_key = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_share_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.num_shell_tries = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.replication_device = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.report_discard_supported = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.reserved_percentage = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.scst_target_driver = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.storage_protocol = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.target_helper = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.target_ip_address = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.target_port = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.target_prefix = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.target_protocol = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.trace_flags = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.use_chap_auth = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_clear = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_clear_size = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] QuobyteHD.volumes_dir = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_notifications.driver = [] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] key_manager.fixed_key = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.barbican_api_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.barbican_endpoint = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.barbican_endpoint_type = public {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.barbican_region_name = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.cafile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.collect_timing = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.number_of_retries = 60 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.retry_delay = 1 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.send_service_user_token = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.split_loggers = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.tls_ciphers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.tls_min_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.verify_ssl = True {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican.verify_ssl_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.auth_section = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.auth_type = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.cafile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.certfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.collect_timing = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.insecure = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.keyfile = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.split_loggers = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.timeout = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.tls_ciphers = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] barbican_service_user.tls_min_version = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.approle_role_id = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.approle_secret_id = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.auth_method = approle {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.auth_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.kv_mountpoint = secret {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.kv_path = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.kv_version = 2 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.namespace = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.root_token_id = **** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.ssl_ca_crt_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.timeout = 60.0 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.token_file = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.token_role = None {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.use_ssl = False {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:56:27 devstack cinder-volume[86797]: DEBUG oslo_service.backend._eventlet.service [None req-9ae3f377-5341-4f70-baf4-24bef3e7d7a6 None None] ******************************************************************************** {{(pid=86797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:56:27 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.258s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:27 devstack cinder-volume[86888]: INFO cinder.volume.driver [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.driver [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2040061950684, 'free_capacity_gb': 1775.2040061950684, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86888) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86888) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writer thread running {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.db.api [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Building query based on filter {{(pid=86888) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86888) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:27 devstack cinder-volume[86888]: INFO cinder.keymgr.migration [None req-d4ef608d-7736-48cb-a4f3-73ebba4aae31 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:56:27 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:56:27 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:28 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.244s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Driver initialization completed successfully. Sep 28 14:56:28 devstack cinder-volume[86888]: INFO cinder.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Initiating service 3 cleanup Sep 28 14:56:28 devstack cinder-volume[86888]: INFO cinder.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Service 3 cleanup completed. Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG cinder.service [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Creating RPC server for service cinder-volume {{(pid=86888) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG cinder.service [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86888) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:56:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:28 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:56:28 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:28 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.262s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6b5460ec-ee68-47b8-8292-b0a0105da0fa None None] Driver post RPC initialization completed successfully. Sep 28 14:56:37 devstack cinder-volume[86797]: DEBUG dbcounter [-] [86797] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:56:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:56:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:56:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 6 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:56:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:40 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:57:40 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:40 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.268s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 6 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:57:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:58:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:40 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:58:40 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:40 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.392s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 6 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:58:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Flow 'volume_create_manager' (012b1eec-31c6-4ff8-99ea-67477766d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00e2b44-156a-423e-924f-3cfb1d3b7f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00e2b44-156a-423e-924f-3cfb1d3b7f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-38438541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be4d4c4-c554-4c83-adb3-88e6f364b1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48f616f5269436d9c880f458d4caaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:02Z,use_quota=True,user_id='c9023d37fc0f45d2b4348be2d0e8ee68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19cdda4-0c8d-46dc-80a8-07f74739e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19cdda4-0c8d-46dc-80a8-07f74739e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726cce3c-b2a6-4e37-aeeb-4aa57667ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726cce3c-b2a6-4e37-aeeb-4aa57667ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be4d4c4-c554-4c83-adb3-88e6f364b1a5', 'volume_name': 'volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66487c54-b3cd-40f3-bfcb-292794a44c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66487c54-b3cd-40f3-bfcb-292794a44c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5775f4e0-a276-4a6c-8937-5316f19bf319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:02 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Volume 1be4d4c4-c554-4c83-adb3-88e6f364b1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5', 'volume_size': 1} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-38438541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be4d4c4-c554-4c83-adb3-88e6f364b1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48f616f5269436d9c880f458d4caaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:02Z,use_quota=True,user_id='c9023d37fc0f45d2b4348be2d0e8ee68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Creating volume 1be4d4c4-c554-4c83-adb3-88e6f364b1a5 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 14:59:02 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 14:59:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:02 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 1073741824 Sep 28 14:59:02 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:03 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 1073741824" returned: 0 in 0.841s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:03 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 Sep 28 14:59:03 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:04 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" returned: 0 in 0.399s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5775f4e0-a276-4a6c-8937-5316f19bf319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbfbf29-f39c-4f06-aede-b8415149ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:04 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Volume volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 (1be4d4c4-c554-4c83-adb3-88e6f364b1a5): created successfully Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbfbf29-f39c-4f06-aede-b8415149ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Flow 'volume_create_manager' (012b1eec-31c6-4ff8-99ea-67477766d12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-01fdb91c-6e56-4fb3-a8e4-af4cbd522f72 tempest-TaggedAttachmentsTest-1382636752 None] Created volume successfully. Sep 28 14:59:14 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:14 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Flow 'volume_create_manager' (33d2f5e8-3689-4bbb-ae32-2cf6859639ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac397a5-33ef-4613-bb73-a4ae27924347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac397a5-33ef-4613-bb73-a4ae27924347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1042894494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59250ea-06e3-428d-bcdd-a3e80da45805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408c3db1f274f34ae45bb47167bf476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:37Z,use_quota=True,user_id='57878cf237fc498db4f9dc8a670108fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63475603-f3d2-4b5b-b15b-9f673cabd504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63475603-f3d2-4b5b-b15b-9f673cabd504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bcf79a-2e51-4ba9-ad98-226a6fcb7226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bcf79a-2e51-4ba9-ad98-226a6fcb7226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59250ea-06e3-428d-bcdd-a3e80da45805', 'volume_name': 'volume-a59250ea-06e3-428d-bcdd-a3e80da45805', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726c8445-1442-4a9d-992a-8cc2d3ba8d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726c8445-1442-4a9d-992a-8cc2d3ba8d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c9d0a1-439c-4ea3-accf-15b23eb27887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Volume a59250ea-06e3-428d-bcdd-a3e80da45805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59250ea-06e3-428d-bcdd-a3e80da45805', 'volume_size': 1} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1042894494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59250ea-06e3-428d-bcdd-a3e80da45805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408c3db1f274f34ae45bb47167bf476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:37Z,use_quota=True,user_id='57878cf237fc498db4f9dc8a670108fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Creating volume a59250ea-06e3-428d-bcdd-a3e80da45805 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 14:59:37 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 14:59:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:37 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 1073741824 Sep 28 14:59:37 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:39 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 1073741824" returned: 0 in 1.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:39 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 Sep 28 14:59:39 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:59:40 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805" returned: 0 in 1.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] <== create_volume: return (3022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.028s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:40 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:59:40 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c9d0a1-439c-4ea3-accf-15b23eb27887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59250ea-06e3-428d-bcdd-a3e80da45805', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6336e9-c8da-4198-b39f-82df174d7b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Volume volume-a59250ea-06e3-428d-bcdd-a3e80da45805 (a59250ea-06e3-428d-bcdd-a3e80da45805): created successfully Sep 28 14:59:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6336e9-c8da-4198-b39f-82df174d7b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Flow 'volume_create_manager' (33d2f5e8-3689-4bbb-ae32-2cf6859639ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-404c37df-c1e3-4d5b-a487-ad5cacbbdf0c tempest-DeleteServersTestJSON-465549397 None] Created volume successfully. Sep 28 14:59:41 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.184s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 6 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:59:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Flow 'volume_create_manager' (c9a0807d-a5a8-4550-af3d-5e0443dcb59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bda3f-5a80-46bf-8ecb-8f8846728d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bda3f-5a80-46bf-8ecb-8f8846728d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-646915749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a24cdd5-5801-4244-899f-c87f6b83fd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b548efc1fec44972a52c5e6bd3820a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:50Z,use_quota=True,user_id='c8f64c733bd94816a645458a3ac798a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4b11f5-9f3a-418a-9711-b1957f31c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4b11f5-9f3a-418a-9711-b1957f31c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05af1ab3-47a3-4bc7-985f-ed688a718948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05af1ab3-47a3-4bc7-985f-ed688a718948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a24cdd5-5801-4244-899f-c87f6b83fd91', 'volume_name': 'volume-9a24cdd5-5801-4244-899f-c87f6b83fd91', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba80621-7461-4333-a386-f8a370affaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba80621-7461-4333-a386-f8a370affaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8c6f86-f517-49e6-8600-f74692b233d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:49 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Volume 9a24cdd5-5801-4244-899f-c87f6b83fd91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a24cdd5-5801-4244-899f-c87f6b83fd91', 'volume_size': 1} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-646915749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a24cdd5-5801-4244-899f-c87f6b83fd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b548efc1fec44972a52c5e6bd3820a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:50Z,use_quota=True,user_id='c8f64c733bd94816a645458a3ac798a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Creating volume 9a24cdd5-5801-4244-899f-c87f6b83fd91 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 14:59:49 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 14:59:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:50 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 1073741824 Sep 28 14:59:50 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:51 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:51 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 1073741824" returned: 0 in 1.257s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:51 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 Sep 28 14:59:51 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:52 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91" returned: 0 in 0.951s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.342s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:52 devstack cinder-volume[86888]: WARNING py.warnings [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 28 14:59:52 devstack cinder-volume[86888]: .first() Sep 28 14:59:52 devstack cinder-volume[86888]: Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8c6f86-f517-49e6-8600-f74692b233d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a24cdd5-5801-4244-899f-c87f6b83fd91', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86958635-bbd8-4972-a00d-3390690073e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Volume volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 (9a24cdd5-5801-4244-899f-c87f6b83fd91): created successfully Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86958635-bbd8-4972-a00d-3390690073e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Flow 'volume_create_manager' (c9a0807d-a5a8-4550-af3d-5e0443dcb59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:52 devstack cinder-volume[86888]: INFO oslo.privsep.daemon [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjg1qo67w/privsep.sock'] Sep 28 14:59:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f433d27d-35a6-4e04-a5e7-a2092cdad952 tempest-VolumesAdminNegativeTest-1950662433 None] Created volume successfully. Sep 28 14:59:52 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjg1qo67w/privsep.sock Sep 28 14:59:52 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Acquiring lock "cinder-9a24cdd5-5801-4244-899f-c87f6b83fd91-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Lock "cinder-9a24cdd5-5801-4244-899f-c87f6b83fd91-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Acquiring lock "cinder-quobyte-9a24cdd5-5801-4244-899f-c87f6b83fd91" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Lock "cinder-quobyte-9a24cdd5-5801-4244-899f-c87f6b83fd91" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 14:59:55 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:55 devstack cinder-volume[86888]: INFO oslo.privsep.daemon [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Spawned new privsep daemon via rootwrap Sep 28 14:59:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Accepted privsep connection to /tmp/tmpjg1qo67w/privsep.sock {{(pid=86888) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 14:59:55 devstack cinder-volume[86888]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 14:59:55 devstack cinder-volume[86888]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 14:59:55 devstack cinder-volume[86888]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 14:59:55 devstack cinder-volume[86888]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88500 Sep 28 14:59:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc850c77-fa41-4959-8453-0edcf1237509]: (2,) {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:55 devstack cinder-volume[86888]: WARNING oslo_privsep.priv_context [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] privsep daemon already running Sep 28 14:59:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1ca128-5672-4e23-91f0-949e0ce76298]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[23adc6b9-1d38-49dd-bd50-77574ec32c17]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:56 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 Sep 28 14:59:56 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:56 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 Sep 28 14:59:56 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:56 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91" returned: 0 in 1.165s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:57 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91 Sep 28 14:59:57 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:57 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805" returned: 0 in 1.301s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.378s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-a59250ea-06e3-428d-bcdd-a3e80da45805', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af9ca321-12a1-4e24-b7ae-6125273e0d5b', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:59:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-627cb501-ae7a-4a35-b382-57b05d25cfdc req-7ac58e46-7630-42b6-9726-c15e181b8112 tempest-DeleteServersTestJSON-465549397 None] attachment_update completed successfully. Sep 28 14:59:57 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a24cdd5-5801-4244-899f-c87f6b83fd91" returned: 0 in 0.822s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Lock "cinder-quobyte-9a24cdd5-5801-4244-899f-c87f6b83fd91" released by "delete_volume" :: held 3.650s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:57 devstack cinder-volume[86888]: WARNING cinder.quota [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:59:57 devstack cinder-volume[86888]: WARNING cinder.quota [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Created reservations ['f2169d51-24d4-41c7-affb-e6f4f1885a08', 'd8958045-64d4-4d36-b63e-bd7c5852ff5e', '1b019f90-6d2d-4c46-b918-967d391bd6de', 'c880c1a5-c274-452d-9fb8-6855ee8b3794'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:58 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 14:59:58 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:58 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.656s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:58 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Deleted volume successfully. Sep 28 14:59:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff198b8c-79c6-476d-be18-acb0efe4d6ab tempest-VolumesAdminNegativeTest-1950662433 None] Lock "cinder-9a24cdd5-5801-4244-899f-c87f6b83fd91-delete_volume" released by "delete_volume" :: held 5.108s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-d866aa66-9e5d-494e-95ad-1a9a9846d251 req-8b809495-3570-4f80-91fb-e8db6eb2a70f tempest-DeleteServersTestJSON-465549397 None] Terminate volume connection completed successfully. Sep 28 15:00:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-d866aa66-9e5d-494e-95ad-1a9a9846d251 req-8b809495-3570-4f80-91fb-e8db6eb2a70f tempest-DeleteServersTestJSON-465549397 None] Deleting attachment af9ca321-12a1-4e24-b7ae-6125273e0d5b. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:00:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Acquiring lock "cinder-a59250ea-06e3-428d-bcdd-a3e80da45805-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Lock "cinder-a59250ea-06e3-428d-bcdd-a3e80da45805-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Acquiring lock "cinder-quobyte-a59250ea-06e3-428d-bcdd-a3e80da45805" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Lock "cinder-quobyte-a59250ea-06e3-428d-bcdd-a3e80da45805" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8479ba-aa5f-44e0-979d-d574b4a2be83]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:08 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 Sep 28 15:00:08 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:09 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805" returned: 0 in 0.605s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:09 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805 Sep 28 15:00:09 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:09 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a59250ea-06e3-428d-bcdd-a3e80da45805" returned: 0 in 0.308s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Lock "cinder-quobyte-a59250ea-06e3-428d-bcdd-a3e80da45805" released by "delete_volume" :: held 0.992s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Created reservations ['368f9250-32ab-42e6-8d7a-b8d1e2544087', '9ed9b001-c083-4b3e-ae30-9d11876aae07', 'debc6ed5-58a9-4872-8f68-fa55922eb3a7', 'f2db386d-4261-46c7-a8f0-1400f5d0d45f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:09 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:00:09 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:10 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.276s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:10 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Deleted volume successfully. Sep 28 15:00:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7614f592-f285-4070-bcd6-383776f32bc0 tempest-DeleteServersTestJSON-465549397 None] Lock "cinder-a59250ea-06e3-428d-bcdd-a3e80da45805-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:19 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:20 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:36 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2304e5-a6c6-45c3-a47c-36da449dd286]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:36 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 Sep 28 15:00:36 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:36 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" returned: 0 in 0.624s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.661s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4107aec1-5f65-4f19-beb2-3c5a08247eab', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:00:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-69783983-a4e9-4c3c-ad5c-228af2aadc52 req-ea104c74-d54a-453b-94c2-46ec9eb683f2 tempest-TaggedAttachmentsTest-1382636752 None] attachment_update completed successfully. Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:40 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:00:40 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:40 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.351s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 8 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:00:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:00:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-726567da-e5bb-4393-b52b-ee0f2f22052b req-72d3ff82-6276-4589-8b1e-fcfc7a497046 tempest-TaggedAttachmentsTest-1382636752 None] Terminate volume connection completed successfully. Sep 28 15:00:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-726567da-e5bb-4393-b52b-ee0f2f22052b req-72d3ff82-6276-4589-8b1e-fcfc7a497046 tempest-TaggedAttachmentsTest-1382636752 None] Deleting attachment 4107aec1-5f65-4f19-beb2-3c5a08247eab. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:00:52 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:52 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Acquiring lock "cinder-1be4d4c4-c554-4c83-adb3-88e6f364b1a5-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Lock "cinder-1be4d4c4-c554-4c83-adb3-88e6f364b1a5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Acquiring lock "cinder-quobyte-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Lock "cinder-quobyte-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a744b4b-0ddd-4ee8-bdc0-9955b964d5b0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:09 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 Sep 28 15:01:09 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:09 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" returned: 0 in 0.557s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:09 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5 Sep 28 15:01:09 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:10 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" returned: 0 in 0.470s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Lock "cinder-quobyte-1be4d4c4-c554-4c83-adb3-88e6f364b1a5" released by "delete_volume" :: held 1.133s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Created reservations ['78ec256b-9ab9-43ed-b7d0-4c636d963ccd', '69e77051-abda-4650-b724-13e4da4df968', '6b02345c-82f1-4659-a5ea-c9cd02bf825a', 'db9f075e-2712-4cef-ae53-7ffb3592694a'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:10 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:10 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:11 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.592s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:11 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Deleted volume successfully. Sep 28 15:01:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05444082-9c49-4aea-a543-272728b1aafe tempest-TaggedAttachmentsTest-1382636752 None] Lock "cinder-1be4d4c4-c554-4c83-adb3-88e6f364b1a5-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Flow 'volume_create_manager' (0b396341-5712-4ce5-92dc-d038c3897742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c527913-86c5-463a-8f71-375ea1782b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c527913-86c5-463a-8f71-375ea1782b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1243267070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486ef1dd-f6be-4497-a41c-a4322a6c842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b27af8735b47e7a5b4b54a97ba617d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:20Z,use_quota=True,user_id='f73d38a380a9477cb1b9d788e58c1772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28cbf86-e7c0-4f95-af0f-c66afa0ccbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28cbf86-e7c0-4f95-af0f-c66afa0ccbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fa2a5b-22f6-4818-ad0b-cf3384202cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fa2a5b-22f6-4818-ad0b-cf3384202cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486ef1dd-f6be-4497-a41c-a4322a6c842e', 'volume_name': 'volume-486ef1dd-f6be-4497-a41c-a4322a6c842e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23e2e25-e338-41b8-86f7-5a5e459d191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23e2e25-e338-41b8-86f7-5a5e459d191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57380021-7786-4a43-87d5-c577fd9556c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:20 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Volume 486ef1dd-f6be-4497-a41c-a4322a6c842e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486ef1dd-f6be-4497-a41c-a4322a6c842e', 'volume_size': 1} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1243267070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486ef1dd-f6be-4497-a41c-a4322a6c842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b27af8735b47e7a5b4b54a97ba617d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:20Z,use_quota=True,user_id='f73d38a380a9477cb1b9d788e58c1772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Creating volume 486ef1dd-f6be-4497-a41c-a4322a6c842e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:01:20 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:01:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:20 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e 1073741824 Sep 28 15:01:20 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:21 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e 1073741824" returned: 0 in 1.091s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:21 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e Sep 28 15:01:21 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:22 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e" returned: 0 in 0.318s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57380021-7786-4a43-87d5-c577fd9556c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486ef1dd-f6be-4497-a41c-a4322a6c842e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49f172f-b672-4c06-888c-23ff01860a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:22 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Volume volume-486ef1dd-f6be-4497-a41c-a4322a6c842e (486ef1dd-f6be-4497-a41c-a4322a6c842e): created successfully Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49f172f-b672-4c06-888c-23ff01860a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Flow 'volume_create_manager' (0b396341-5712-4ce5-92dc-d038c3897742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dfc4dcc6-73b3-424f-b46e-0e0ae1bad1a9 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Created volume successfully. Sep 28 15:01:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "cinder-486ef1dd-f6be-4497-a41c-a4322a6c842e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "cinder-486ef1dd-f6be-4497-a41c-a4322a6c842e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "cinder-quobyte-486ef1dd-f6be-4497-a41c-a4322a6c842e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "cinder-quobyte-486ef1dd-f6be-4497-a41c-a4322a6c842e" acquired by "delete_volume" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:23 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[24548572-a106-471c-8331-2fb5074c40dc]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:23 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e Sep 28 15:01:23 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:24 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e" returned: 0 in 0.499s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:24 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e Sep 28 15:01:24 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:24 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-486ef1dd-f6be-4497-a41c-a4322a6c842e" returned: 0 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "cinder-quobyte-486ef1dd-f6be-4497-a41c-a4322a6c842e" released by "delete_volume" :: held 0.937s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Created reservations ['89bb03a3-e596-4a7a-8e27-64c1726e7d56', 'a6f13aa6-5761-49c6-9f38-ca86fdd46d04', 'f68507fc-0ebb-4278-9053-ccdbc1544739', '8f92e5c3-1e43-429a-a5bf-9b8bbae9c7c3'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:24 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:24 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:25 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.311s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:25 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Deleted volume successfully. Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-031c5778-5043-4913-9ef5-1cc78f234b18 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "cinder-486ef1dd-f6be-4497-a41c-a4322a6c842e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Flow 'volume_create_manager' (0f2db722-ac69-4443-b23a-7f200ef165b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb403e4-ad42-426a-af6c-92263c6da423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb403e4-ad42-426a-af6c-92263c6da423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1942838663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06461e34-95ab-4ab4-8800-7c38e1a0ebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788c4923e2c7494e95d3b7544d229d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:26Z,use_quota=True,user_id='f39756a12c2b43ddab6de2e8681dc139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be57902-e4f2-4ebd-92ee-212afc6b9955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be57902-e4f2-4ebd-92ee-212afc6b9955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295df488-3165-4958-8710-6a2d6f440110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295df488-3165-4958-8710-6a2d6f440110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06461e34-95ab-4ab4-8800-7c38e1a0ebe5', 'volume_name': 'volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d2424f-c8b8-4888-ac89-f2ba7720add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d2424f-c8b8-4888-ac89-f2ba7720add1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1a08a5-80dc-4023-ab29-137df9b9ed2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:25 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Volume 06461e34-95ab-4ab4-8800-7c38e1a0ebe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5', 'volume_size': 1} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1942838663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06461e34-95ab-4ab4-8800-7c38e1a0ebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788c4923e2c7494e95d3b7544d229d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:26Z,use_quota=True,user_id='f39756a12c2b43ddab6de2e8681dc139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Creating volume 06461e34-95ab-4ab4-8800-7c38e1a0ebe5 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:01:25 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:01:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:26 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 1073741824 Sep 28 15:01:26 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Flow 'volume_create_manager' (95ffecee-dfb7-41ce-bf59-f8ca64090ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef85f769-77a3-4c1b-9901-356daed00d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:26 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 1073741824" returned: 0 in 0.612s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef85f769-77a3-4c1b-9901-356daed00d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1225232929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7a9f85-f9d5-4829-913a-776204ac9a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b27af8735b47e7a5b4b54a97ba617d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:27Z,use_quota=True,user_id='f73d38a380a9477cb1b9d788e58c1772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b30da1-db27-4b52-8388-06bdfe66404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b30da1-db27-4b52-8388-06bdfe66404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c825779b-8981-4f24-95cd-8d6623618b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c825779b-8981-4f24-95cd-8d6623618b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7a9f85-f9d5-4829-913a-776204ac9a02', 'volume_name': 'volume-3f7a9f85-f9d5-4829-913a-776204ac9a02', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea61dd2f-4981-4fd6-9c2c-b7d7197c0d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea61dd2f-4981-4fd6-9c2c-b7d7197c0d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3f1486-76fb-4b44-96f5-4172be8490b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Volume 3f7a9f85-f9d5-4829-913a-776204ac9a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7a9f85-f9d5-4829-913a-776204ac9a02', 'volume_size': 1} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:26 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 Sep 28 15:01:26 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:27 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1225232929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7a9f85-f9d5-4829-913a-776204ac9a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b27af8735b47e7a5b4b54a97ba617d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:27Z,use_quota=True,user_id='f73d38a380a9477cb1b9d788e58c1772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Creating volume 3f7a9f85-f9d5-4829-913a-776204ac9a02 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:01:27 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1a08a5-80dc-4023-ab29-137df9b9ed2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1248239-0a9e-47df-895e-6b4a52c2e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:27 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 1073741824 Sep 28 15:01:27 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Volume volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 (06461e34-95ab-4ab4-8800-7c38e1a0ebe5): created successfully Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1248239-0a9e-47df-895e-6b4a52c2e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Flow 'volume_create_manager' (0f2db722-ac69-4443-b23a-7f200ef165b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-43686a13-3cca-4b2c-bf2a-ad33b633ad3c tempest-ServersNegativeTestJSON-744863107 None] Created volume successfully. Sep 28 15:01:27 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 1073741824" returned: 0 in 0.783s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:27 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 Sep 28 15:01:27 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:28 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3f1486-76fb-4b44-96f5-4172be8490b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7a9f85-f9d5-4829-913a-776204ac9a02', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82fa75f-f0d3-4cd6-b256-42e336f08ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:28 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Volume volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 (3f7a9f85-f9d5-4829-913a-776204ac9a02): created successfully Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82fa75f-f0d3-4cd6-b256-42e336f08ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Flow 'volume_create_manager' (95ffecee-dfb7-41ce-bf59-f8ca64090ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8896f17b-f47b-45bc-a181-16f41ba9ed85 tempest-VolumeQuotasAdminTestJSON-1500426691 None] Created volume successfully. Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Flow 'volume_create_manager' (03cf50dc-c99e-4996-918f-d0bd851f1119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cddf4d-8321-4b3c-b29f-6412725bbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cddf4d-8321-4b3c-b29f-6412725bbd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1998579112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d924540-4989-4b6d-8d61-5de866c07154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788c4923e2c7494e95d3b7544d229d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:30Z,use_quota=True,user_id='f39756a12c2b43ddab6de2e8681dc139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf85a05-58aa-4732-94b9-4a275a667a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf85a05-58aa-4732-94b9-4a275a667a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da14b16-a77d-4741-9e6d-6fdc41caf2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da14b16-a77d-4741-9e6d-6fdc41caf2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d924540-4989-4b6d-8d61-5de866c07154', 'volume_name': 'volume-5d924540-4989-4b6d-8d61-5de866c07154', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e7b270-78a2-4ab2-b136-1c025f3b1a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e7b270-78a2-4ab2-b136-1c025f3b1a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d8d3c4-7b35-4780-9900-520bb94c12de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Volume 5d924540-4989-4b6d-8d61-5de866c07154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d924540-4989-4b6d-8d61-5de866c07154', 'volume_size': 1} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1998579112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d924540-4989-4b6d-8d61-5de866c07154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788c4923e2c7494e95d3b7544d229d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:30Z,use_quota=True,user_id='f39756a12c2b43ddab6de2e8681dc139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Creating volume 5d924540-4989-4b6d-8d61-5de866c07154 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:01:30 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:01:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 1073741824 Sep 28 15:01:30 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d5f69845-808a-4905-a699-0450009d52fb tempest-VolumeQuotasAdminTestJSON-1601489090 None] Transfer volume completed successfully. Sep 28 15:01:31 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 1073741824" returned: 0 in 0.692s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:31 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 Sep 28 15:01:31 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Acquiring lock "cinder-3f7a9f85-f9d5-4829-913a-776204ac9a02-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Lock "cinder-3f7a9f85-f9d5-4829-913a-776204ac9a02-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Acquiring lock "cinder-quobyte-3f7a9f85-f9d5-4829-913a-776204ac9a02" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Lock "cinder-quobyte-3f7a9f85-f9d5-4829-913a-776204ac9a02" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a1e646-140e-457b-bb43-b0e4c4b42776]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:31 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154" returned: 0 in 0.394s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d8d3c4-7b35-4780-9900-520bb94c12de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d924540-4989-4b6d-8d61-5de866c07154', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf5dd69-c016-4a7c-a4a5-91b709b2ab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Volume volume-5d924540-4989-4b6d-8d61-5de866c07154 (5d924540-4989-4b6d-8d61-5de866c07154): created successfully Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf5dd69-c016-4a7c-a4a5-91b709b2ab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Flow 'volume_create_manager' (03cf50dc-c99e-4996-918f-d0bd851f1119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:31 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 Sep 28 15:01:31 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-077389ee-2c36-40af-b29d-ea540621766a tempest-ServersNegativeTestJSON-744863107 None] Created volume successfully. Sep 28 15:01:32 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02" returned: 0 in 0.506s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:32 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02 Sep 28 15:01:32 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:32 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3f7a9f85-f9d5-4829-913a-776204ac9a02" returned: 0 in 0.337s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Lock "cinder-quobyte-3f7a9f85-f9d5-4829-913a-776204ac9a02" released by "delete_volume" :: held 0.926s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Created reservations ['75973969-088e-4cbb-bb74-ffd71303f76f', 'bd238fb6-40c6-4ef3-b5cc-09f7ad113d90', '4835a84b-a7eb-42c9-b782-c7243248d3ec', '1f7d35b3-85aa-4429-843e-d598e9273526'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:33 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:33 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Flow 'volume_create_manager' (63a1e43b-fce0-497e-b166-45d638f929ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b20327-bf34-4026-ace3-3859b35a5bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b20327-bf34-4026-ace3-3859b35a5bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-374324836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626c43068a747fc9076fe13564990d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:33Z,use_quota=True,user_id='ae70575c6bca4fb6bfc605598ce02519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91120efd-c0a0-4472-8587-7ab67f05de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91120efd-c0a0-4472-8587-7ab67f05de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8dce7-e02f-4586-8d69-b32632e8bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8dce7-e02f-4586-8d69-b32632e8bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2', 'volume_name': 'volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ff5d97-cf51-46ec-8b50-a850760d252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ff5d97-cf51-46ec-8b50-a850760d252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac067a74-bdc5-459a-8a10-83db25d4d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Volume a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2', 'volume_size': 1} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-374324836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626c43068a747fc9076fe13564990d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:33Z,use_quota=True,user_id='ae70575c6bca4fb6bfc605598ce02519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Creating volume a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:01:33 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:33 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 1073741824 Sep 28 15:01:33 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:33 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.410s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Deleted volume successfully. Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0235e91d-aaef-4078-9525-dbaa605e7a04 tempest-VolumeQuotasAdminTestJSON-1515499760 None] Lock "cinder-3f7a9f85-f9d5-4829-913a-776204ac9a02-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "cinder-5d924540-4989-4b6d-8d61-5de866c07154-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-5d924540-4989-4b6d-8d61-5de866c07154-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "cinder-quobyte-5d924540-4989-4b6d-8d61-5de866c07154" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-quobyte-5d924540-4989-4b6d-8d61-5de866c07154" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d2c8e6-41f5-4d7d-a0ce-67146932aafe]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:33 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 Sep 28 15:01:33 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:34 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 1073741824" returned: 0 in 1.057s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:34 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154" returned: 0 in 0.776s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:34 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 Sep 28 15:01:34 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:34 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154 Sep 28 15:01:34 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:34 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac067a74-bdc5-459a-8a10-83db25d4d52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e1898d-673e-453a-b910-550485b45169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Volume volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 (a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2): created successfully Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e1898d-673e-453a-b910-550485b45169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Flow 'volume_create_manager' (63a1e43b-fce0-497e-b166-45d638f929ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5aadacfd-548e-432c-8013-da729271edef tempest-ServerActionsTestOtherA-1898348918 None] Created volume successfully. Sep 28 15:01:35 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5d924540-4989-4b6d-8d61-5de866c07154" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-quobyte-5d924540-4989-4b6d-8d61-5de866c07154" released by "delete_volume" :: held 1.490s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Created reservations ['781e201a-fe81-4597-86f8-7c694972cb45', '74cda0c6-f74c-4741-b894-43f0a1bd4fc0', '35e3f521-b5b5-413b-9649-36ea68631b20', '353d0f20-9504-4214-b304-1193a4ce629b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:35 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:35 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:35 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Deleted volume successfully. Sep 28 15:01:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54413f52-638c-45ca-9669-daee12e64016 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-5d924540-4989-4b6d-8d61-5de866c07154-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "cinder-06461e34-95ab-4ab4-8800-7c38e1a0ebe5-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-06461e34-95ab-4ab4-8800-7c38e1a0ebe5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "cinder-quobyte-06461e34-95ab-4ab4-8800-7c38e1a0ebe5" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-quobyte-06461e34-95ab-4ab4-8800-7c38e1a0ebe5" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8b171c-b783-4e19-a752-c43b0c3051b4]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:36 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 Sep 28 15:01:36 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:36 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5" returned: 0 in 0.601s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:36 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5 Sep 28 15:01:36 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:37 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06461e34-95ab-4ab4-8800-7c38e1a0ebe5" returned: 0 in 0.358s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-quobyte-06461e34-95ab-4ab4-8800-7c38e1a0ebe5" released by "delete_volume" :: held 1.034s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Created reservations ['1f0c4a46-7bc3-4050-a136-46c0f659f291', '87f03545-2db4-4378-ab0b-3eaa76e2c7df', '8963df12-3058-49c2-a107-374a564e8940', '436b72fe-90f4-4e9e-b069-5666245b4958'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:37 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:37 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:37 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.367s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Deleted volume successfully. Sep 28 15:01:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c12231b-ae24-47a6-b92c-e73ab56e3db4 tempest-ServersNegativeTestJSON-744863107 None] Lock "cinder-06461e34-95ab-4ab4-8800-7c38e1a0ebe5-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:40 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:40 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:41 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.509s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:47 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=56,cinder:SELECT=35,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:47 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=54,cinder:DELETE=5 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Flow 'volume_create_manager' (4a30843c-f2c5-4da7-b8f8-270a62c11931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641b794d-2b57-4d62-9dab-488b990cb9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641b794d-2b57-4d62-9dab-488b990cb9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1626788598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5fb36-dbe9-4109-973d-2f533967ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77eb97ee99e43119d0cc4ad33bbc57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:48Z,use_quota=True,user_id='ddc3c0439be746a9bfb25344fbe1ebfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb0715d-5dc8-4d28-bfd1-2f49057cd29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb0715d-5dc8-4d28-bfd1-2f49057cd29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e99d4d9-7c6a-4190-982b-32f8923942e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e99d4d9-7c6a-4190-982b-32f8923942e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c5fb36-dbe9-4109-973d-2f533967ea69', 'volume_name': 'volume-14c5fb36-dbe9-4109-973d-2f533967ea69', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3696b40-44ab-4462-ba6e-0968f1f6e94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3696b40-44ab-4462-ba6e-0968f1f6e94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1158f9c-f9a1-4a11-9a0b-12152fdbe1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Volume 14c5fb36-dbe9-4109-973d-2f533967ea69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c5fb36-dbe9-4109-973d-2f533967ea69', 'volume_size': 1} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1626788598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5fb36-dbe9-4109-973d-2f533967ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77eb97ee99e43119d0cc4ad33bbc57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:48Z,use_quota=True,user_id='ddc3c0439be746a9bfb25344fbe1ebfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Creating volume 14c5fb36-dbe9-4109-973d-2f533967ea69 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:01:48 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:01:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:48 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 1073741824 Sep 28 15:01:48 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:49 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 1073741824" returned: 0 in 0.700s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:49 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 Sep 28 15:01:49 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:49 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69" returned: 0 in 0.380s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1158f9c-f9a1-4a11-9a0b-12152fdbe1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c5fb36-dbe9-4109-973d-2f533967ea69', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f64d6bf-c9aa-4748-90fa-4ffae2db1397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:49 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Volume volume-14c5fb36-dbe9-4109-973d-2f533967ea69 (14c5fb36-dbe9-4109-973d-2f533967ea69): created successfully Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f64d6bf-c9aa-4748-90fa-4ffae2db1397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Flow 'volume_create_manager' (4a30843c-f2c5-4da7-b8f8-270a62c11931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-725190de-fb39-4015-8b30-ed24b1d353af tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Created volume successfully. Sep 28 15:01:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Acquiring lock "cinder-14c5fb36-dbe9-4109-973d-2f533967ea69-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "cinder-14c5fb36-dbe9-4109-973d-2f533967ea69-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Acquiring lock "cinder-quobyte-14c5fb36-dbe9-4109-973d-2f533967ea69" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "cinder-quobyte-14c5fb36-dbe9-4109-973d-2f533967ea69" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bdab89-b4f5-425f-9a40-40dfd8718fd0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:52 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 Sep 28 15:01:52 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:52 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69" returned: 0 in 0.627s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:52 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69 Sep 28 15:01:52 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:53 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-14c5fb36-dbe9-4109-973d-2f533967ea69" returned: 0 in 0.407s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "cinder-quobyte-14c5fb36-dbe9-4109-973d-2f533967ea69" released by "delete_volume" :: held 1.127s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Created reservations ['0c841c18-5d59-4a07-916b-8c965abc4a03', 'f2e97b51-5273-4bfa-93b3-7ef2892857a9', '78039e58-937d-4b75-9c17-ebedd2fae7b9', '919d5391-6da4-4c69-bb93-cfc116e19ac8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:53 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:01:53 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:53 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.428s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Deleted volume successfully. Sep 28 15:01:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6915b6d2-e283-4b29-bd45-cf02be88b60e tempest-VolumeQuotasNegativeTestJSON-1677421897 None] Lock "cinder-14c5fb36-dbe9-4109-973d-2f533967ea69-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:03 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:03 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=15,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Flow 'volume_create_manager' (fd94c7e8-7de7-41d6-9d1c-84630575c233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10b17f5-42c3-486f-9ef2-fac1110d286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10b17f5-42c3-486f-9ef2-fac1110d286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1021646104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f15e06-9db5-4c1a-9337-04b27a99da40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548c8eb63a9b4ca39bd9865808fc8e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:22Z,use_quota=True,user_id='82aa65c2b8cb457b85832af1cedc60bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(868833ed-becc-4815-bc8a-2dd521128b0c),volume_type_id=868833ed-becc-4815-bc8a-2dd521128b0c)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fe992a-5b24-4e1c-9502-ceb3d4521282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fe992a-5b24-4e1c-9502-ceb3d4521282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35759e5-76bb-4651-be09-cbfc8522bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35759e5-76bb-4651-be09-cbfc8522bd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f15e06-9db5-4c1a-9337-04b27a99da40', 'volume_name': 'volume-59f15e06-9db5-4c1a-9337-04b27a99da40', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b57441b-c30f-4b06-bad9-06f15f8dcf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b57441b-c30f-4b06-bad9-06f15f8dcf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21312657-3402-4707-bb04-349c74b233f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:22 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Volume 59f15e06-9db5-4c1a-9337-04b27a99da40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f15e06-9db5-4c1a-9337-04b27a99da40', 'volume_size': 1} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1021646104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f15e06-9db5-4c1a-9337-04b27a99da40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548c8eb63a9b4ca39bd9865808fc8e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:22Z,use_quota=True,user_id='82aa65c2b8cb457b85832af1cedc60bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(868833ed-becc-4815-bc8a-2dd521128b0c),volume_type_id=868833ed-becc-4815-bc8a-2dd521128b0c)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Creating volume 59f15e06-9db5-4c1a-9337-04b27a99da40 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:02:22 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:02:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:22 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 1073741824 Sep 28 15:02:22 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:23 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 1073741824" returned: 0 in 0.903s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:23 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 Sep 28 15:02:23 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:23 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40" returned: 0 in 0.544s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:02:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21312657-3402-4707-bb04-349c74b233f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f15e06-9db5-4c1a-9337-04b27a99da40', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8493838b-3924-4db1-8515-33bfa4739e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Volume volume-59f15e06-9db5-4c1a-9337-04b27a99da40 (59f15e06-9db5-4c1a-9337-04b27a99da40): created successfully Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8493838b-3924-4db1-8515-33bfa4739e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Flow 'volume_create_manager' (fd94c7e8-7de7-41d6-9d1c-84630575c233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a91260cc-1d88-4aa9-88d9-0e14e4d09cf8 tempest-VolumeTypesAccessTest-748036873 None] Created volume successfully. Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Acquiring lock "cinder-59f15e06-9db5-4c1a-9337-04b27a99da40-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Lock "cinder-59f15e06-9db5-4c1a-9337-04b27a99da40-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Acquiring lock "cinder-quobyte-59f15e06-9db5-4c1a-9337-04b27a99da40" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Lock "cinder-quobyte-59f15e06-9db5-4c1a-9337-04b27a99da40" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e36582-5acb-41e9-ab2c-9eb8e58dd1d3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:25 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 Sep 28 15:02:25 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:25 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40" returned: 0 in 0.781s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:25 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40 Sep 28 15:02:25 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:26 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-59f15e06-9db5-4c1a-9337-04b27a99da40" returned: 0 in 0.515s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Lock "cinder-quobyte-59f15e06-9db5-4c1a-9337-04b27a99da40" released by "delete_volume" :: held 1.417s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:26 devstack cinder-volume[86888]: WARNING cinder.quota [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1529002272 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1529002272, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:26 devstack cinder-volume[86888]: WARNING cinder.quota [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1529002272 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1529002272, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Created reservations ['4163bb0b-296d-4649-98e9-172f079f02bc', '00713b0c-1776-4305-aeeb-ddb4edc05b97', 'b73026c9-de87-45ef-87f9-584fc879256e', '37f796fb-bac5-4e14-a751-60729e18052a'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:26 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:02:26 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:27 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.456s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:27 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Deleted volume successfully. Sep 28 15:02:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d2a4227a-fcf0-4869-99f7-3083eae7d04a tempest-VolumeTypesAccessTest-748036873 None] Lock "cinder-59f15e06-9db5-4c1a-9337-04b27a99da40-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ce143-cce7-4249-9602-f767ae576a8e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:28 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 Sep 28 15:02:28 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:28 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" returned: 0 in 0.618s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.638s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e1e4d40-96e9-4aa7-8ee1-bccf72c0583a', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:02:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-56f6fc9a-369f-49a5-8c10-e77cfcd3c118 req-b8b9dca7-7916-45f7-89c0-d03c01a104b3 tempest-ServerActionsTestOtherA-1898348918 None] attachment_update completed successfully. Sep 28 15:02:36 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-198d0fed-801b-410b-84ab-8062d36b5375 req-e313198f-3780-428a-b29d-90a2c965625d tempest-ServerActionsTestOtherA-1898348918 None] Terminate volume connection completed successfully. Sep 28 15:02:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-198d0fed-801b-410b-84ab-8062d36b5375 req-e313198f-3780-428a-b29d-90a2c965625d tempest-ServerActionsTestOtherA-1898348918 None] Deleting attachment 9e1e4d40-96e9-4aa7-8ee1-bccf72c0583a. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1535b-54eb-463c-ad83-e30a9143dd74]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:38 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 Sep 28 15:02:38 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:38 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" returned: 0 in 0.710s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.753s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a42048b0-8c26-4f82-b0fb-8a43d3b178f3', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:02:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-198d0fed-801b-410b-84ab-8062d36b5375 req-44112e84-ca99-4631-8971-7feeba89a751 tempest-ServerActionsTestOtherA-1898348918 None] attachment_update completed successfully. Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:40 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:02:40 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:41 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.739s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 8 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:02:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:02:45 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Flow 'volume_create_manager' (33f1fa02-bb84-46fc-88c7-7be3db624240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8600e5-55a0-40ca-a403-b967fa0537f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8600e5-55a0-40ca-a403-b967fa0537f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-817154320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed039671-7fe9-4d71-b5b6-5f52b97c92dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7090aad07f3141cda15bd35b74f7f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:46Z,use_quota=True,user_id='ebf18c7e5d8d4e088ea4dabceb4c07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f5da4e-149e-4ac6-9382-9642c32571f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f5da4e-149e-4ac6-9382-9642c32571f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2262513-2aa9-4d91-b18d-b4d6d9ec7d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2262513-2aa9-4d91-b18d-b4d6d9ec7d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed039671-7fe9-4d71-b5b6-5f52b97c92dc', 'volume_name': 'volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8195c9-7bcb-4381-9f31-05ab57685be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8195c9-7bcb-4381-9f31-05ab57685be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2767667c-beee-48bf-8665-f71df525632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Volume ed039671-7fe9-4d71-b5b6-5f52b97c92dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc', 'volume_size': 1} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-817154320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed039671-7fe9-4d71-b5b6-5f52b97c92dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7090aad07f3141cda15bd35b74f7f364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:46Z,use_quota=True,user_id='ebf18c7e5d8d4e088ea4dabceb4c07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Creating volume ed039671-7fe9-4d71-b5b6-5f52b97c92dc {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:02:46 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:02:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:46 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc 1073741824 Sep 28 15:02:46 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:46 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc 1073741824" returned: 0 in 0.909s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc Sep 28 15:02:47 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc" returned: 0 in 0.581s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2767667c-beee-48bf-8665-f71df525632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453edbe3-9775-4507-9054-52cc3e9863ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Volume volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc (ed039671-7fe9-4d71-b5b6-5f52b97c92dc): created successfully Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453edbe3-9775-4507-9054-52cc3e9863ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Flow 'volume_create_manager' (33f1fa02-bb84-46fc-88c7-7be3db624240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4d1abf3d-74ff-49ec-bb86-64a0fac4df3c tempest-AttachVolumeShelveTestJSON-34809056 None] Created volume successfully. Sep 28 15:02:57 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=14,cinder:SELECT=21,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:57 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Flow 'volume_create_manager' (1eeecdb8-086a-4c74-83e3-db40d9645493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6876bc-d2e5-434a-ab30-6a65c41ee220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6876bc-d2e5-434a-ab30-6a65c41ee220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-566162747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435c22cc-eb6d-41e6-bef8-8cd18e7da3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccf22005b4f483ebadbe4df128993c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:01Z,use_quota=True,user_id='c78a4530f2b54fffbb75db27d6065200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad3a405-669f-47dc-b90e-ff919461eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad3a405-669f-47dc-b90e-ff919461eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec062ab8-a4c5-4232-a3c3-c26aa2747d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec062ab8-a4c5-4232-a3c3-c26aa2747d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435c22cc-eb6d-41e6-bef8-8cd18e7da3b0', 'volume_name': 'volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374ac739-2f10-4261-bf43-503a874e2daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374ac739-2f10-4261-bf43-503a874e2daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba9f39e-6bcc-4137-b3d5-0aa46ddaf381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Volume 435c22cc-eb6d-41e6-bef8-8cd18e7da3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0', 'volume_size': 1} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-566162747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435c22cc-eb6d-41e6-bef8-8cd18e7da3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccf22005b4f483ebadbe4df128993c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:01Z,use_quota=True,user_id='c78a4530f2b54fffbb75db27d6065200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Creating volume 435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:00 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:01 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 1073741824 Sep 28 15:03:01 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 1073741824" returned: 0 in 0.718s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:01 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 Sep 28 15:03:01 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:02 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" returned: 0 in 0.363s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba9f39e-6bcc-4137-b3d5-0aa46ddaf381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fde4d6-3898-4c31-9218-8ce97c2f09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:02 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Volume volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 (435c22cc-eb6d-41e6-bef8-8cd18e7da3b0): created successfully Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fde4d6-3898-4c31-9218-8ce97c2f09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Flow 'volume_create_manager' (1eeecdb8-086a-4c74-83e3-db40d9645493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4abc90cc-519a-4743-b4e3-daf9dac49ead tempest-AttachVolumeNegativeTest-958876162 None] Created volume successfully. Sep 28 15:03:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-7a8f7048-5bbf-4b76-b399-2e7fcfb8d735 req-6bbb5c68-45a2-44b8-a148-382b8ed0c041 tempest-AttachVolumeShelveTestJSON-34809056 None] No connector for attachment d89088cc-95f3-44fb-a204-ceaa3ee9522e; skipping storage backend terminate_connection call. {{(pid=86888) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 15:03:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-7a8f7048-5bbf-4b76-b399-2e7fcfb8d735 req-6bbb5c68-45a2-44b8-a148-382b8ed0c041 tempest-AttachVolumeShelveTestJSON-34809056 None] Deleting attachment d89088cc-95f3-44fb-a204-ceaa3ee9522e. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:03 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebecbf-940a-4582-aee1-9cde1d3f608e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 Sep 28 15:03:03 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:04 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" returned: 0 in 0.548s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.577s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3ee9ebf-e994-4c7b-af80-1006362b6277', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-e69731a3-ba2b-4dae-8949-adcd61f284cf req-fb8d60f9-9a26-4908-a6e0-9394b26eda54 tempest-AttachVolumeNegativeTest-958876162 None] attachment_update completed successfully. Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Flow 'volume_create_manager' (c1c7eb53-ddb2-404a-a094-554c9dd917c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e8260-d312-40f6-ac4f-cf95e24c8154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e8260-d312-40f6-ac4f-cf95e24c8154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-775202377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d47f4e-96b1-4304-aa33-bac8890ed46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5067bb8b8374322b68dea276f1f12c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:06Z,use_quota=True,user_id='2c07993c14974484b673a06a6c07cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5991bd25-948e-4bd8-8611-c8992d13ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5991bd25-948e-4bd8-8611-c8992d13ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd623f6-63f9-4bdb-9fcf-865cf3d33d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd623f6-63f9-4bdb-9fcf-865cf3d33d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d47f4e-96b1-4304-aa33-bac8890ed46e', 'volume_name': 'volume-77d47f4e-96b1-4304-aa33-bac8890ed46e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cf232b-8c5d-4322-966d-88409cd8b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cf232b-8c5d-4322-966d-88409cd8b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6fcea0-ba93-4eac-84c6-e3914e849b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:06 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Volume 77d47f4e-96b1-4304-aa33-bac8890ed46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d47f4e-96b1-4304-aa33-bac8890ed46e', 'volume_size': 1} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-775202377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d47f4e-96b1-4304-aa33-bac8890ed46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5067bb8b8374322b68dea276f1f12c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:06Z,use_quota=True,user_id='2c07993c14974484b673a06a6c07cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Creating volume 77d47f4e-96b1-4304-aa33-bac8890ed46e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:06 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:06 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e 1073741824 Sep 28 15:03:06 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:06 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e 1073741824" returned: 0 in 0.644s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:06 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e Sep 28 15:03:06 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:07 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e" returned: 0 in 0.371s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6fcea0-ba93-4eac-84c6-e3914e849b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d47f4e-96b1-4304-aa33-bac8890ed46e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36bb105-254e-44d3-87b8-d29b19ac6b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:07 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Volume volume-77d47f4e-96b1-4304-aa33-bac8890ed46e (77d47f4e-96b1-4304-aa33-bac8890ed46e): created successfully Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36bb105-254e-44d3-87b8-d29b19ac6b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Flow 'volume_create_manager' (c1c7eb53-ddb2-404a-a094-554c9dd917c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0d4f98c9-92e3-47ba-8df9-6b7aef7f7738 tempest-VolumesListAdminTestJSON-1197376102 None] Created volume successfully. Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Flow 'volume_create_manager' (fd19fc17-dd0f-4b30-b5aa-cd25c342851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e81e40-d9a0-4ba6-bd93-40c0fb47f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e81e40-d9a0-4ba6-bd93-40c0fb47f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1472786741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3309993b-e6fa-4f3b-b3e6-00d855eebe97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5067bb8b8374322b68dea276f1f12c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:09Z,use_quota=True,user_id='2c07993c14974484b673a06a6c07cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ba3975-e5ba-425f-98cf-2992d2dc18f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ba3975-e5ba-425f-98cf-2992d2dc18f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd979579-b369-4c86-9154-046c45f4e560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd979579-b369-4c86-9154-046c45f4e560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3309993b-e6fa-4f3b-b3e6-00d855eebe97', 'volume_name': 'volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e96c5d8-272c-4312-9d68-c6dd6633bd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e96c5d8-272c-4312-9d68-c6dd6633bd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96be021-d0c9-46c1-ad6a-a94ceec75248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Volume 3309993b-e6fa-4f3b-b3e6-00d855eebe97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97', 'volume_size': 1} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1472786741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3309993b-e6fa-4f3b-b3e6-00d855eebe97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5067bb8b8374322b68dea276f1f12c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:09Z,use_quota=True,user_id='2c07993c14974484b673a06a6c07cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Creating volume 3309993b-e6fa-4f3b-b3e6-00d855eebe97 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:08 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:08 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 1073741824 Sep 28 15:03:08 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:09 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 1073741824" returned: 0 in 1.000s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:10 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 Sep 28 15:03:10 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:10 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97" returned: 0 in 0.543s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96be021-d0c9-46c1-ad6a-a94ceec75248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9907fb-f6f8-4392-ba5f-bcb9c6ba224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Volume volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 (3309993b-e6fa-4f3b-b3e6-00d855eebe97): created successfully Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9907fb-f6f8-4392-ba5f-bcb9c6ba224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Flow 'volume_create_manager' (fd19fc17-dd0f-4b30-b5aa-cd25c342851c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3de3d2b5-f92c-43e4-9eec-eb77b27e2730 tempest-VolumesListAdminTestJSON-1197376102 None] Created volume successfully. Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Flow 'volume_create_manager' (aca67373-e106-4f3f-80cc-2afb61cb2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75da032a-bc58-42c8-a776-6441e8c48794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75da032a-bc58-42c8-a776-6441e8c48794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-685427426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e144928-c573-4c3c-977e-2c67a880bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5067bb8b8374322b68dea276f1f12c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:12Z,use_quota=True,user_id='2c07993c14974484b673a06a6c07cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591cebbd-1ac4-4260-a41c-ee8145ed85a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591cebbd-1ac4-4260-a41c-ee8145ed85a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff19e285-095d-4de9-beb2-94cf012784cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff19e285-095d-4de9-beb2-94cf012784cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e144928-c573-4c3c-977e-2c67a880bfee', 'volume_name': 'volume-7e144928-c573-4c3c-977e-2c67a880bfee', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3111e6d-971b-4143-a44e-5498fefe7697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3111e6d-971b-4143-a44e-5498fefe7697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023f7e09-c0cf-4232-8b6e-0f3268654158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:12 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Volume 7e144928-c573-4c3c-977e-2c67a880bfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e144928-c573-4c3c-977e-2c67a880bfee', 'volume_size': 1} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-685427426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e144928-c573-4c3c-977e-2c67a880bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5067bb8b8374322b68dea276f1f12c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:12Z,use_quota=True,user_id='2c07993c14974484b673a06a6c07cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Creating volume 7e144928-c573-4c3c-977e-2c67a880bfee {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:12 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:12 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee 1073741824 Sep 28 15:03:12 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:13 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee 1073741824" returned: 0 in 0.744s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:13 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee Sep 28 15:03:13 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:13 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee" returned: 0 in 0.509s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023f7e09-c0cf-4232-8b6e-0f3268654158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e144928-c573-4c3c-977e-2c67a880bfee', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b93e0a1-72d6-4db9-a57b-235d0b65625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:13 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Volume volume-7e144928-c573-4c3c-977e-2c67a880bfee (7e144928-c573-4c3c-977e-2c67a880bfee): created successfully Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b93e0a1-72d6-4db9-a57b-235d0b65625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Flow 'volume_create_manager' (aca67373-e106-4f3f-80cc-2afb61cb2289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7f0c2a36-f9ef-4f3e-a725-ea25a8610d82 tempest-VolumesListAdminTestJSON-1197376102 None] Created volume successfully. Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Flow 'volume_create_manager' (fa3b99a1-9376-4f66-8dc8-82ca0fd58e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d754ec56-8dbc-44b3-ac91-2b0d44356f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d754ec56-8dbc-44b3-ac91-2b0d44356f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aade5c5-8f65-40e0-af5c-cd0f1fc72def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b52b201c3f4488a829eb592e9efada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:16Z,use_quota=True,user_id='c0a8b0cbadd14296a74e8f407a9c7181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349873ca-cf15-4f61-a123-fd919f916b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349873ca-cf15-4f61-a123-fd919f916b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c410e1-76ca-41e0-aaa6-53f9f6ee0772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c410e1-76ca-41e0-aaa6-53f9f6ee0772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aade5c5-8f65-40e0-af5c-cd0f1fc72def', 'volume_name': 'volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a21d0ee-f9a2-4f32-b3a4-3240a571ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a21d0ee-f9a2-4f32-b3a4-3240a571ff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba224ec-a7e2-4664-9fc5-37d6c0ecca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:16 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Volume 8aade5c5-8f65-40e0-af5c-cd0f1fc72def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def', 'volume_size': 1} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aade5c5-8f65-40e0-af5c-cd0f1fc72def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b52b201c3f4488a829eb592e9efada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:16Z,use_quota=True,user_id='c0a8b0cbadd14296a74e8f407a9c7181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Creating volume 8aade5c5-8f65-40e0-af5c-cd0f1fc72def {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:16 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:16 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def 1073741824 Sep 28 15:03:16 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:17 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def 1073741824" returned: 0 in 0.934s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:17 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def Sep 28 15:03:17 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:17 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def" returned: 0 in 0.388s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba224ec-a7e2-4664-9fc5-37d6c0ecca81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319ed3ff-0578-4200-bbe6-6fe877809ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Volume volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def (8aade5c5-8f65-40e0-af5c-cd0f1fc72def): created successfully Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319ed3ff-0578-4200-bbe6-6fe877809ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Flow 'volume_create_manager' (fa3b99a1-9376-4f66-8dc8-82ca0fd58e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f6ee111c-ba37-453c-b204-6de79b6699f9 tempest-VolumesListAdminTestJSON-1684746373 None] Created volume successfully. Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Acquiring lock "cinder-8aade5c5-8f65-40e0-af5c-cd0f1fc72def-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Lock "cinder-8aade5c5-8f65-40e0-af5c-cd0f1fc72def-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Acquiring lock "cinder-quobyte-8aade5c5-8f65-40e0-af5c-cd0f1fc72def" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Lock "cinder-quobyte-8aade5c5-8f65-40e0-af5c-cd0f1fc72def" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e369413-b482-4176-ac1b-9f88c8b634ab]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "cinder-7e144928-c573-4c3c-977e-2c67a880bfee-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-7e144928-c573-4c3c-977e-2c67a880bfee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "cinder-quobyte-7e144928-c573-4c3c-977e-2c67a880bfee" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-quobyte-7e144928-c573-4c3c-977e-2c67a880bfee" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd04953-c652-4ee1-bace-ca802f2251be]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:18 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def Sep 28 15:03:18 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:19 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee Sep 28 15:03:19 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:19 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def" returned: 0 in 1.246s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:19 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def Sep 28 15:03:19 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:20 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee" returned: 0 in 1.330s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:20 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee Sep 28 15:03:20 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:20 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8aade5c5-8f65-40e0-af5c-cd0f1fc72def" returned: 0 in 1.068s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Lock "cinder-quobyte-8aade5c5-8f65-40e0-af5c-cd0f1fc72def" released by "delete_volume" :: held 2.403s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:20 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e144928-c573-4c3c-977e-2c67a880bfee" returned: 0 in 0.838s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-quobyte-7e144928-c573-4c3c-977e-2c67a880bfee" released by "delete_volume" :: held 2.300s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Created reservations ['65d85f20-93e0-402f-b136-fca4acc832c1', '0c9f226b-58a9-475e-9250-7f882f37e4bd', '82b93984-844f-4d2c-8b16-4992917bd490', '871445dc-6fbc-4614-9c97-2b4949d78ceb'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Created reservations ['b1800df8-d239-4e72-9376-b26a8776b83e', '62178040-be2e-4b8d-886c-a74c192f09fd', '5f4e889e-2a9b-48c8-a93b-944bd8913ae1', '524f3e18-befd-478a-a4cc-5e976c988347'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:21 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:03:21 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:21 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:03:21 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:21 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Deleted volume successfully. Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2a67227a-2cd8-4e31-8476-caa7a71e143a tempest-VolumesListAdminTestJSON-1684746373 None] Lock "cinder-8aade5c5-8f65-40e0-af5c-cd0f1fc72def-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:21 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.474s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Deleted volume successfully. Sep 28 15:03:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a4242eca-06dd-4b37-8e10-012e4271b5f7 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-7e144928-c573-4c3c-977e-2c67a880bfee-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "cinder-3309993b-e6fa-4f3b-b3e6-00d855eebe97-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-3309993b-e6fa-4f3b-b3e6-00d855eebe97-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "cinder-quobyte-3309993b-e6fa-4f3b-b3e6-00d855eebe97" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-quobyte-3309993b-e6fa-4f3b-b3e6-00d855eebe97" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7542065f-331f-4f0c-a17e-4c599d701aae]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:22 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 Sep 28 15:03:22 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:23 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97" returned: 0 in 0.784s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97 Sep 28 15:03:23 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:23 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3309993b-e6fa-4f3b-b3e6-00d855eebe97" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-quobyte-3309993b-e6fa-4f3b-b3e6-00d855eebe97" released by "delete_volume" :: held 1.239s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Created reservations ['a6acfc55-789e-47fc-b768-b61e300a2128', '59cf16ca-eb39-4bf9-9721-ac440346950d', '862d6d98-4444-4c7c-9606-0d04b6558d5e', '72de9e6c-d835-4e45-a20f-39683eb5adff'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:03:23 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.447s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Deleted volume successfully. Sep 28 15:03:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e6ea6e9c-dfae-49c0-a803-3ef61369e224 tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-3309993b-e6fa-4f3b-b3e6-00d855eebe97-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "cinder-77d47f4e-96b1-4304-aa33-bac8890ed46e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-77d47f4e-96b1-4304-aa33-bac8890ed46e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "cinder-quobyte-77d47f4e-96b1-4304-aa33-bac8890ed46e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-quobyte-77d47f4e-96b1-4304-aa33-bac8890ed46e" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b67978-76f3-43ff-87c5-6e438eaf5739]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:25 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e Sep 28 15:03:25 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:26 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e" returned: 0 in 0.758s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:26 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e Sep 28 15:03:26 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:26 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-a30da281-64b4-44c1-8c8e-aae49bfa3c03 req-a7510f5a-cb27-4d5f-bada-7cb45d39cbc2 tempest-ServerActionsTestOtherA-1898348918 None] Terminate volume connection completed successfully. Sep 28 15:03:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-a30da281-64b4-44c1-8c8e-aae49bfa3c03 req-a7510f5a-cb27-4d5f-bada-7cb45d39cbc2 tempest-ServerActionsTestOtherA-1898348918 None] Deleting attachment a42048b0-8c26-4f82-b0fb-8a43d3b178f3. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:03:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77d47f4e-96b1-4304-aa33-bac8890ed46e" returned: 0 in 0.697s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-quobyte-77d47f4e-96b1-4304-aa33-bac8890ed46e" released by "delete_volume" :: held 1.540s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:26 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Created reservations ['89284a21-649a-4378-aa25-ed1b06679f35', '7a22e198-8989-4a94-a86e-1eef1dbc68d5', '1d2ccd9a-93df-4914-a792-2194e8f102b4', '0f119ba7-2ec9-4752-b268-7865beaf7158'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack sudo[92316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:03:27 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.600s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Deleted volume successfully. Sep 28 15:03:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8921b8e5-20ec-485a-9363-6963421daa9b tempest-VolumesListAdminTestJSON-1197376102 None] Lock "cinder-77d47f4e-96b1-4304-aa33-bac8890ed46e-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:37 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=35,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:37 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=40,cinder:SELECT=40,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Flow 'volume_create_manager' (8ab097ad-1a87-4e1c-afb7-5aaa18fff621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e876805-7026-49e5-a12d-c2d3eac5049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e876805-7026-49e5-a12d-c2d3eac5049b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1093376943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16253157-827e-48d1-b728-7c57e72e3c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626c43068a747fc9076fe13564990d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:40Z,use_quota=True,user_id='ae70575c6bca4fb6bfc605598ce02519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b770fba2-680d-4d7a-b69a-662b2da7b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b770fba2-680d-4d7a-b69a-662b2da7b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d9b7e-3ff3-4ddd-988c-32e3b1086425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:03:40 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57d9b7e-3ff3-4ddd-988c-32e3b1086425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16253157-827e-48d1-b728-7c57e72e3c69', 'volume_name': 'volume-16253157-827e-48d1-b728-7c57e72e3c69', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190fa220-dfa4-41ad-a456-467d78cfec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190fa220-dfa4-41ad-a456-467d78cfec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c971a1fc-231a-4a68-a32c-78bcbd0a1b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Volume 16253157-827e-48d1-b728-7c57e72e3c69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16253157-827e-48d1-b728-7c57e72e3c69', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Trying to clone 16253157-827e-48d1-b728-7c57e72e3c69 from image 014259cc-3d70-4b12-abe4-95d560fe7bff at location (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:03:41 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.563s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 8 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Flow 'volume_create_manager' (3a3f7041-8edc-4ece-bcb5-377f3c91d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b9d82-8285-4062-8ee1-1dd2edd053bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b9d82-8285-4062-8ee1-1dd2edd053bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-161709542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed297970-20c8-4d12-aa2e-659788bee709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df748d91e024a0dbe0a99ad0801537b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:41Z,use_quota=True,user_id='1009a6c2621c40fe84e1416926060b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c247f89-2480-45d2-91a2-5f86c1096b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c247f89-2480-45d2-91a2-5f86c1096b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b1162f-5a5c-4fd7-b818-ed602200ff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b1162f-5a5c-4fd7-b818-ed602200ff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed297970-20c8-4d12-aa2e-659788bee709', 'volume_name': 'volume-ed297970-20c8-4d12-aa2e-659788bee709', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb0dba5-3e9c-4aaa-a69b-43b801f1281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb0dba5-3e9c-4aaa-a69b-43b801f1281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fa4ba3-7eec-44bf-8f46-1d77f1e30241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Volume ed297970-20c8-4d12-aa2e-659788bee709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed297970-20c8-4d12-aa2e-659788bee709', 'volume_size': 1} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-161709542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed297970-20c8-4d12-aa2e-659788bee709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df748d91e024a0dbe0a99ad0801537b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:41Z,use_quota=True,user_id='1009a6c2621c40fe84e1416926060b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Creating volume ed297970-20c8-4d12-aa2e-659788bee709 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:41 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:41 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 1073741824 Sep 28 15:03:41 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:03:41 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3e71a-ba19-4cf2-81a4-446d3ceb335d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:41 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD Sep 28 15:03:41 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:42 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 1073741824" returned: 0 in 0.560s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff is fetched for user ae70575c6bca4fb6bfc605598ce02519. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 Sep 28 15:03:42 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b117fded-4a2b-46c2-8c74-24d25aabdfae]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD Sep 28 15:03:42 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:42 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709" returned: 0 in 0.289s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fa4ba3-7eec-44bf-8f46-1d77f1e30241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed297970-20c8-4d12-aa2e-659788bee709', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5340f5-8d58-4440-b07a-596ccf25cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:42 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Volume volume-ed297970-20c8-4d12-aa2e-659788bee709 (ed297970-20c8-4d12-aa2e-659788bee709): created successfully Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5340f5-8d58-4440-b07a-596ccf25cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Flow 'volume_create_manager' (3a3f7041-8edc-4ece-bcb5-377f3c91d177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ab816df6-07e3-4619-89eb-d37b06e24446 tempest-AbsoluteLimitsTests-1247658980 None] Created volume successfully. Sep 28 15:03:42 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1093376943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16253157-827e-48d1-b728-7c57e72e3c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626c43068a747fc9076fe13564990d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:40Z,use_quota=True,user_id='ae70575c6bca4fb6bfc605598ce02519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Creating volume 16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:42 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 1073741824 Sep 28 15:03:42 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 1073741824" returned: 0 in 0.755s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:03:43 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Acquiring lock "cinder-ed297970-20c8-4d12-aa2e-659788bee709-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Lock "cinder-ed297970-20c8-4d12-aa2e-659788bee709-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Acquiring lock "cinder-quobyte-ed297970-20c8-4d12-aa2e-659788bee709" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:43 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 0.460s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Lock "cinder-quobyte-ed297970-20c8-4d12-aa2e-659788bee709" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b4b0d-1472-48ce-bdce-f0e24890ddd1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Attempting download of 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume 16253157-827e-48d1-b728-7c57e72e3c69. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdfc294-c65d-4778-a74b-0f12a0e3d303]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 Sep 28 15:03:44 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30 Sep 28 15:03:44 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30 Sep 28 15:03:44 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709" returned: 0 in 0.611s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709 Sep 28 15:03:44 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30" returned: 1 in 0.389s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_gdy4pb30' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8a1bc-4d05-4745-8b5e-a0aba75ddd20]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed297970-20c8-4d12-aa2e-659788bee709" returned: 0 in 0.297s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Lock "cinder-quobyte-ed297970-20c8-4d12-aa2e-659788bee709" released by "delete_volume" :: held 0.982s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:44 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Created reservations ['a1f171de-322f-410a-88c5-1bc7d08a7445', 'c76e0469-4db1-4095-afcf-619508d9d888', '598c6721-30bd-42a3-b8d1-d0f6bd1968cc', '92683866-5faf-4d27-9bc6-ce08d7b3397d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:45 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD Sep 28 15:03:45 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:45 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:03:45 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:45 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] 014259cc-3d70-4b12-abe4-95d560fe7bff was qcow2, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:45 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:03:45 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:45 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.327s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Deleted volume successfully. Sep 28 15:03:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd4f3a17-2b1a-49bd-8f78-ac598e4d17d4 tempest-AbsoluteLimitsTests-1247658980 None] Lock "cinder-ed297970-20c8-4d12-aa2e-659788bee709-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:47 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 2.049s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff__9s0rflydevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:03:47 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Converted 112.00 MB image at 54.64 MB/s Sep 28 15:03:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 1G Sep 28 15:03:47 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:47 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 1G" returned: 0 in 0.359s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c91f24-3f52-4789-b2f8-5d311ce4e33a]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:03:47 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 0.519s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:48 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:03:48 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 1 in 0.450s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Downloaded image 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume 16253157-827e-48d1-b728-7c57e72e3c69 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff for user ae70575c6bca4fb6bfc605598ce02519 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Marking volume 16253157-827e-48d1-b728-7c57e72e3c69 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Copying metadata from image 014259cc-3d70-4b12-abe4-95d560fe7bff to 16253157-827e-48d1-b728-7c57e72e3c69. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Creating volume glance metadata for volume 16253157-827e-48d1-b728-7c57e72e3c69 backed by image 014259cc-3d70-4b12-abe4-95d560fe7bff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c971a1fc-231a-4a68-a32c-78bcbd0a1b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16253157-827e-48d1-b728-7c57e72e3c69', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01538ec4-ff88-4938-a752-f59c0806d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Volume volume-16253157-827e-48d1-b728-7c57e72e3c69 (16253157-827e-48d1-b728-7c57e72e3c69): created successfully Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01538ec4-ff88-4938-a752-f59c0806d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Flow 'volume_create_manager' (8ab097ad-1a87-4e1c-afb7-5aaa18fff621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-57d51342-f5f0-4e3b-884d-5d2aac308480 tempest-ServerActionsTestOtherA-1898348918 None] Created volume successfully. Sep 28 15:03:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f14866-61f2-40a0-8041-6413d9cb43ba]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:54 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:03:54 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:54 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 0.662s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:54 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:03:54 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:55 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 1 in 0.534s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.254s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-16253157-827e-48d1-b728-7c57e72e3c69', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d6f071d-dea1-4f2c-8f9e-839a456fc3b1', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Flow 'volume_create_manager' (3d52d4f6-b7fb-463f-875e-0efc01a51082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc60650-fdc7-4aee-bd02-de0d7b83c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc60650-fdc7-4aee-bd02-de0d7b83c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1614296615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456c376e-1d4e-4515-8957-a30aa8299c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa125b7b23c64fae81db556d45be4443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:55Z,use_quota=True,user_id='ace12ddf34d940718a5b706a0ddfee95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307e2cd7-b91a-46c8-9de8-488b99cf2c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307e2cd7-b91a-46c8-9de8-488b99cf2c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804e3e83-776e-4432-b670-973c396e7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804e3e83-776e-4432-b670-973c396e7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456c376e-1d4e-4515-8957-a30aa8299c4a', 'volume_name': 'volume-456c376e-1d4e-4515-8957-a30aa8299c4a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d177fc03-3331-4666-b367-c9192bc53bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d177fc03-3331-4666-b367-c9192bc53bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a66431f-1727-40ce-b1fb-ae4b306543e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:55 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Volume 456c376e-1d4e-4515-8957-a30aa8299c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456c376e-1d4e-4515-8957-a30aa8299c4a', 'volume_size': 1} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1614296615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456c376e-1d4e-4515-8957-a30aa8299c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa125b7b23c64fae81db556d45be4443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:55Z,use_quota=True,user_id='ace12ddf34d940718a5b706a0ddfee95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Creating volume 456c376e-1d4e-4515-8957-a30aa8299c4a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:03:55 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:03:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:55 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a 1073741824 Sep 28 15:03:55 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c1b6d625-45ff-4c1f-8b21-42bd1cf6d323 req-090b4ec7-48c3-4ce2-a149-148e71ed76e1 tempest-ServerActionsTestOtherA-1898348918 None] attachment_update completed successfully. Sep 28 15:03:56 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a 1073741824" returned: 0 in 0.700s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:56 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a Sep 28 15:03:56 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:56 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a" returned: 0 in 0.342s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a66431f-1727-40ce-b1fb-ae4b306543e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456c376e-1d4e-4515-8957-a30aa8299c4a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e47ab-841f-4562-b323-386cb61786b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Volume volume-456c376e-1d4e-4515-8957-a30aa8299c4a (456c376e-1d4e-4515-8957-a30aa8299c4a): created successfully Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e47ab-841f-4562-b323-386cb61786b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Flow 'volume_create_manager' (3d52d4f6-b7fb-463f-875e-0efc01a51082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0eb506ec-4616-4dfe-86af-84fa05ffbcba tempest-VolumesTransfersTest-534118300 None] Created volume successfully. Sep 28 15:03:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e79df30e-2ea8-4cf1-bff8-290f1511c35b tempest-VolumesTransfersTest-1807835007 None] Transfer volume completed successfully. Sep 28 15:03:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Acquiring lock "cinder-456c376e-1d4e-4515-8957-a30aa8299c4a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-456c376e-1d4e-4515-8957-a30aa8299c4a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Acquiring lock "cinder-quobyte-456c376e-1d4e-4515-8957-a30aa8299c4a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-quobyte-456c376e-1d4e-4515-8957-a30aa8299c4a" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:00 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[218866a8-e81a-4fa3-a780-fe83b544bdd6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:00 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a Sep 28 15:04:00 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:00 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a" returned: 0 in 0.809s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:00 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a Sep 28 15:04:00 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-456c376e-1d4e-4515-8957-a30aa8299c4a" returned: 0 in 0.633s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-quobyte-456c376e-1d4e-4515-8957-a30aa8299c4a" released by "delete_volume" :: held 1.532s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Created reservations ['e03fffbf-560d-4ad1-beff-87331ffa5bc3', 'd30192c1-e5a3-4462-bb26-fdbe2f14407d', 'f5b92a22-9f70-4807-a0e3-bae1af219a86', 'e6d48a5c-a6e4-4be4-899f-69e20f4a0be1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:01 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:02 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.655s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Deleted volume successfully. Sep 28 15:04:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c18d73f-708a-42fe-b065-dc723edac7f6 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-456c376e-1d4e-4515-8957-a30aa8299c4a-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Flow 'volume_create_manager' (422cdab7-4094-4b01-bbb2-4522a35fa629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdddfe2c-c938-4805-9c6d-9837e9de92f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdddfe2c-c938-4805-9c6d-9837e9de92f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-660002112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2058bb-8eba-400a-b9bc-2b3e12e3c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa125b7b23c64fae81db556d45be4443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:03Z,use_quota=True,user_id='ace12ddf34d940718a5b706a0ddfee95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d363d3d0-6e79-40e3-a269-bd7bfdf3375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d363d3d0-6e79-40e3-a269-bd7bfdf3375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d3873a-ee9e-4cfc-b87e-777d53e2b780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d3873a-ee9e-4cfc-b87e-777d53e2b780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2058bb-8eba-400a-b9bc-2b3e12e3c26a', 'volume_name': 'volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d83c81d-24fd-4c6e-98df-01ab165578a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d83c81d-24fd-4c6e-98df-01ab165578a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ab415f-a91b-421d-a646-4ab016b66ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:03 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Volume df2058bb-8eba-400a-b9bc-2b3e12e3c26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a', 'volume_size': 1} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-660002112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2058bb-8eba-400a-b9bc-2b3e12e3c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa125b7b23c64fae81db556d45be4443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:03Z,use_quota=True,user_id='ace12ddf34d940718a5b706a0ddfee95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Creating volume df2058bb-8eba-400a-b9bc-2b3e12e3c26a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:04:03 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:04:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:03 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a 1073741824 Sep 28 15:04:03 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:04 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a 1073741824" returned: 0 in 1.196s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:05 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a Sep 28 15:04:05 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:05 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Acquiring lock "cinder-ed039671-7fe9-4d71-b5b6-5f52b97c92dc-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a" returned: 0 in 0.991s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "cinder-ed039671-7fe9-4d71-b5b6-5f52b97c92dc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ab415f-a91b-421d-a646-4ab016b66ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865c8ee7-1269-447e-b56c-0dd6e6a5c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:06 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Volume volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a (df2058bb-8eba-400a-b9bc-2b3e12e3c26a): created successfully Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865c8ee7-1269-447e-b56c-0dd6e6a5c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Flow 'volume_create_manager' (422cdab7-4094-4b01-bbb2-4522a35fa629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Acquiring lock "cinder-quobyte-ed039671-7fe9-4d71-b5b6-5f52b97c92dc" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8474d003-9dd9-4fdb-a98b-4b0705288767 tempest-VolumesTransfersTest-534118300 None] Created volume successfully. Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "cinder-quobyte-ed039671-7fe9-4d71-b5b6-5f52b97c92dc" acquired by "delete_volume" :: waited 0.065s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885d722-3a27-4d79-8e3b-7cd824308429]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:06 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc Sep 28 15:04:06 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:06 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc" returned: 0 in 0.586s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:06 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc Sep 28 15:04:06 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:07 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ed039671-7fe9-4d71-b5b6-5f52b97c92dc" returned: 0 in 0.453s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "cinder-quobyte-ed039671-7fe9-4d71-b5b6-5f52b97c92dc" released by "delete_volume" :: held 1.126s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Created reservations ['cc8581d2-fc76-4ea1-b2f2-44e536e9cc7b', '2a03e060-3f6e-45d0-9dcc-0dcac1927997', '35f98e36-e971-4ea8-ba73-90cfb7695283', '15fbb411-6327-4e8c-9843-3195825a01b5'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Acquiring lock "cinder-df2058bb-8eba-400a-b9bc-2b3e12e3c26a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:07 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:07 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-df2058bb-8eba-400a-b9bc-2b3e12e3c26a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Acquiring lock "cinder-quobyte-df2058bb-8eba-400a-b9bc-2b3e12e3c26a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-quobyte-df2058bb-8eba-400a-b9bc-2b3e12e3c26a" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[568308d9-a67c-48d2-a77d-153b159ea038]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:08 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a Sep 28 15:04:08 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:08 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.759s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Deleted volume successfully. Sep 28 15:04:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-99299383-e409-4795-9a30-3ee97487da75 tempest-AttachVolumeShelveTestJSON-34809056 None] Lock "cinder-ed039671-7fe9-4d71-b5b6-5f52b97c92dc-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:08 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a" returned: 0 in 0.964s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:08 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a Sep 28 15:04:08 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:09 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-df2058bb-8eba-400a-b9bc-2b3e12e3c26a" returned: 0 in 0.694s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-quobyte-df2058bb-8eba-400a-b9bc-2b3e12e3c26a" released by "delete_volume" :: held 1.743s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Created reservations ['9fd9e93e-cd47-48bf-8f17-3bebcad7b74e', '624d8529-1e82-4c67-b65f-35cd061ee142', 'c767100b-6d1a-496e-b317-ecb9391cfcba', '364578b3-fe2f-48f8-bd18-66333614af8c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:09 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:09 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:10 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.406s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:10 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Deleted volume successfully. Sep 28 15:04:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3e9b7213-bf01-4650-93ae-d8e59f50d2d2 tempest-VolumesTransfersTest-422644321 None] Lock "cinder-df2058bb-8eba-400a-b9bc-2b3e12e3c26a-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-a3bf7588-da17-4fa2-95d3-4835bc973803 req-fd0855ca-7ef9-4103-84c5-39050a10b329 tempest-AttachVolumeNegativeTest-958876162 None] Terminate volume connection completed successfully. Sep 28 15:04:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-a3bf7588-da17-4fa2-95d3-4835bc973803 req-fd0855ca-7ef9-4103-84c5-39050a10b329 tempest-AttachVolumeNegativeTest-958876162 None] Deleting attachment d3ee9ebf-e994-4c7b-af80-1006362b6277. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:23 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=53,cinder:SELECT=40,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:23 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=45,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-4082599b-0657-41b5-9493-142fe5235d31 tempest-ServerActionsTestOtherA-1898348918 None] Terminate volume connection completed successfully. Sep 28 15:04:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-4082599b-0657-41b5-9493-142fe5235d31 tempest-ServerActionsTestOtherA-1898348918 None] Deleting attachment 7d6f071d-dea1-4f2c-8f9e-839a456fc3b1. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Flow 'volume_create_manager' (288b4c56-6af6-4e4d-93a2-9bed4faed17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5d84a6-348c-481b-bacd-f859221bb717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5d84a6-348c-481b-bacd-f859221bb717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-721449849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf5691-0bf3-4ba1-a3b9-7503aec4a532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df445b0416e54ac082bd44b930e2c658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:25Z,use_quota=True,user_id='e684651f29364fe68bc6d6488d529f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb47d2e0-e5c2-4ea7-93b8-2acab5b3d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb47d2e0-e5c2-4ea7-93b8-2acab5b3d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed63b41-5a0f-4c43-b8a3-60cf326a7646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed63b41-5a0f-4c43-b8a3-60cf326a7646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'volume_name': 'volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60333199-803d-4c48-8e4e-cc9f365f7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60333199-803d-4c48-8e4e-cc9f365f7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5d49f9-b02d-4c23-8a6b-a154b4bdbd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Volume 0eaf5691-0bf3-4ba1-a3b9-7503aec4a532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'volume_size': 1} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-721449849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf5691-0bf3-4ba1-a3b9-7503aec4a532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df445b0416e54ac082bd44b930e2c658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:25Z,use_quota=True,user_id='e684651f29364fe68bc6d6488d529f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Creating volume 0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:04:25 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:04:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:25 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 1073741824 Sep 28 15:04:25 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Flow 'volume_create_manager' (64bbd5b4-16e7-4672-ada1-0197a5132a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab0dcae-b291-4525-9fda-2cea470cc4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab0dcae-b291-4525-9fda-2cea470cc4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-214170713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823d31cc-9c4b-4380-a233-08da251a47e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff18333db5064d57952b8e3f4ad5b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:26Z,use_quota=True,user_id='e94914b5e2934313aff747cab6cf70ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0720e3-4cb9-40d3-a765-16357540cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0720e3-4cb9-40d3-a765-16357540cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ac3ec9-8882-4da9-857a-816c767beb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ac3ec9-8882-4da9-857a-816c767beb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823d31cc-9c4b-4380-a233-08da251a47e7', 'volume_name': 'volume-823d31cc-9c4b-4380-a233-08da251a47e7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67553f8-d2c2-4e7c-aff3-0ec7d1902406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67553f8-d2c2-4e7c-aff3-0ec7d1902406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d798644b-1bf6-4ac8-8f8b-1bcd4268a2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Volume 823d31cc-9c4b-4380-a233-08da251a47e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823d31cc-9c4b-4380-a233-08da251a47e7', 'volume_size': 1} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 1073741824" returned: 0 in 0.796s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:26 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:26 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 0.343s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-214170713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823d31cc-9c4b-4380-a233-08da251a47e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff18333db5064d57952b8e3f4ad5b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:26Z,use_quota=True,user_id='e94914b5e2934313aff747cab6cf70ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Creating volume 823d31cc-9c4b-4380-a233-08da251a47e7 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:04:26 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:26 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 1073741824 Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5d49f9-b02d-4c23-8a6b-a154b4bdbd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6be0df-d7c8-4c8a-a3a0-8bba426fff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Volume volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 (0eaf5691-0bf3-4ba1-a3b9-7503aec4a532): created successfully Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6be0df-d7c8-4c8a-a3a0-8bba426fff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Flow 'volume_create_manager' (288b4c56-6af6-4e4d-93a2-9bed4faed17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a5044be7-5db2-4be0-9d46-eb4ab0bb8048 tempest-VolumesCloneTest-1646098129 None] Created volume successfully. Sep 28 15:04:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:27 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 1073741824" returned: 0 in 0.638s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:27 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 Sep 28 15:04:27 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:27 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7" returned: 0 in 0.375s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.925s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d798644b-1bf6-4ac8-8f8b-1bcd4268a2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823d31cc-9c4b-4380-a233-08da251a47e7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2e1526-8e60-4c42-b943-72e7b9e24beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[03765d74-1651-47f2-b5f7-0abd58d7ab33]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Volume volume-823d31cc-9c4b-4380-a233-08da251a47e7 (823d31cc-9c4b-4380-a233-08da251a47e7): created successfully Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2e1526-8e60-4c42-b943-72e7b9e24beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Flow 'volume_create_manager' (64bbd5b4-16e7-4672-ada1-0197a5132a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e01d5868-6dfe-497b-939d-84cd37eea8a1 tempest-VolumesTestJSON-1310980074 None] Created volume successfully. Sep 28 15:04:28 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:04:28 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Flow 'volume_create_manager' (8e9b1780-b885-4cd4-b060-62ab9139f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2934915a-f1db-4d09-8934-f176bd4e7f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2934915a-f1db-4d09-8934-f176bd4e7f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1396413245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0d60c5-a092-4f27-8e61-73cb3524d44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df445b0416e54ac082bd44b930e2c658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0eaf5691-0bf3-4ba1-a3b9-7503aec4a532,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:28Z,use_quota=True,user_id='e684651f29364fe68bc6d6488d529f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90baad13-3997-4066-9128-feab281c5917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90baad13-3997-4066-9128-feab281c5917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11617e84-b731-4e1a-bbb0-8b71e1bf757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11617e84-b731-4e1a-bbb0-8b71e1bf757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9a0d60c5-a092-4f27-8e61-73cb3524d44c', 'volume_name': 'volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c', 'volume_size': 2, 'source_volid': '0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'source_volstatus': 'available'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:28 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d185154-e4c6-49d2-857a-2a136340390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d185154-e4c6-49d2-857a-2a136340390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239a217b-e8e6-4603-a9fc-dd5ba8728afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:28 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Volume 9a0d60c5-a092-4f27-8e61-73cb3524d44c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c', 'volume_size': 2, 'source_volid': '0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'source_volstatus': 'available'} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 0.721s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:28 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:04:28 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:29 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 1 in 0.574s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.362s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.566s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:29 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Cloning volume 0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 to volume 9a0d60c5-a092-4f27-8e61-73cb3524d44c Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Flow 'volume_create_manager' (8bdf9682-70bc-4e27-a562-eb37a8be9697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7871ab28-b50d-442f-a0b7-fc1fec79eb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7871ab28-b50d-442f-a0b7-fc1fec79eb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-927963455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bff1227-59f6-4b96-8e2c-bb24b1a8db0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff18333db5064d57952b8e3f4ad5b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:29Z,use_quota=True,user_id='e94914b5e2934313aff747cab6cf70ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4f39a1-4b53-4fa0-8c36-1655d3bcd1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4f39a1-4b53-4fa0-8c36-1655d3bcd1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4faba4e-bdfa-49fd-8636-b63a040b87e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4faba4e-bdfa-49fd-8636-b63a040b87e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bff1227-59f6-4b96-8e2c-bb24b1a8db0d', 'volume_name': 'volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b22bca-3773-4237-99c0-d2322bfb71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b22bca-3773-4237-99c0-d2322bfb71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbd3165-28e2-40d4-b274-3cb93c9d4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:29 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Volume 2bff1227-59f6-4b96-8e2c-bb24b1a8db0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d', 'volume_size': 1} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-16253157-827e-48d1-b728-7c57e72e3c69', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cee825a6-bd61-4a32-8403-473c4715937e', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Creating offline snapshot db6bf5a2-d394-4d22-bf5e-8b0aa585bccd of volume 0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea59c04-6c67-4e7a-ab3d-1181845b524a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-59d53fd6-20cf-440e-aecd-f430e5ee67f7 req-8c6816ba-8be2-4107-b1d6-f8fbcf2c36e7 tempest-ServerActionsTestOtherA-1898348918 None] attachment_update completed successfully. Sep 28 15:04:29 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:29 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:30 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 0.713s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:30 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd 1G Sep 28 15:04:30 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:31 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd 1G" returned: 0 in 1.133s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:31 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd Sep 28 15:04:31 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:32 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" returned: 0 in 0.628s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:32 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd is being set with open permissions: ugo+rw Sep 28 15:04:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:32 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd Sep 28 15:04:32 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:32 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" returned: 0 in 0.387s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:32 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info Sep 28 15:04:32 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:32 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info" returned: 0 in 0.444s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:32 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info is being set with open permissions: ugo+rw Sep 28 15:04:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:32 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info Sep 28 15:04:32 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:33 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.info" returned: 0 in 0.450s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "cinder-quobyte-9a0d60c5-a092-4f27-8e61-73cb3524d44c" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-9a0d60c5-a092-4f27-8e61-73cb3524d44c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] snapshot: db6bf5a2-d394-4d22-bf5e-8b0aa585bccd, volume: 9a0d60c5-a092-4f27-8e61-73cb3524d44c, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cf0872-c0d3-4e96-9daa-02a5c317fd47]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:33 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd Sep 28 15:04:33 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:34 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" returned: 0 in 0.796s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a5cd7-f6f2-4d0c-a514-6672bbbaec26]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:34 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:34 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:34 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 0.621s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:04:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:35 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c Sep 28 15:04:35 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:40 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:40 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:41 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.883s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 28 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:04:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:04:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-7da7d011-083f-428f-9cc2-f365f2c1ad45 tempest-ServerActionsTestOtherA-1898348918 None] Terminate volume connection completed successfully. Sep 28 15:04:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-7da7d011-083f-428f-9cc2-f365f2c1ad45 tempest-ServerActionsTestOtherA-1898348918 None] Deleting attachment cee825a6-bd61-4a32-8403-473c4715937e. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:42 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "cinder-16253157-827e-48d1-b728-7c57e72e3c69-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-16253157-827e-48d1-b728-7c57e72e3c69-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "cinder-quobyte-16253157-827e-48d1-b728-7c57e72e3c69" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-quobyte-16253157-827e-48d1-b728-7c57e72e3c69" acquired by "delete_volume" :: waited 0.072s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b966cebe-052b-44b2-a9c2-d5dd3909dd42]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "cinder-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "cinder-quobyte-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-quobyte-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" acquired by "delete_volume" :: waited 0.142s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:44 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:04:44 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8c91eb-4a7a-4a38-9e40-1c394fbb93d6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:45 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 Sep 28 15:04:45 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:45 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 2.496s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:46 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" returned: 0 in 1.791s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:46 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:04:46 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:46 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2 Sep 28 15:04:46 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:47 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 1 in 1.679s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:04:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:47 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69 Sep 28 15:04:47 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:47 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" returned: 0 in 1.558s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-quobyte-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2" released by "delete_volume" :: held 3.653s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Created reservations ['8fcbe27c-af88-4b9b-851e-09446d011be7', '5a978ee7-e554-4d08-b5aa-ee9cd4df0960', 'd8ac35cb-89cb-45b6-934a-cb86a1ead0a2', '1b8c5215-93c4-455c-86da-39e9b3375f3f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:48 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:48 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:48 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-16253157-827e-48d1-b728-7c57e72e3c69" returned: 0 in 1.095s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-quobyte-16253157-827e-48d1-b728-7c57e72e3c69" released by "delete_volume" :: held 5.706s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:48 devstack cinder-volume[86888]: DEBUG cinder.quota [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Created reservations ['8b19e270-36ac-403e-9339-672f7e5db737', '5cee6ae7-320f-492f-817d-907dc4d49dfd', '57ca5124-6876-4d90-85dc-737c1c4afeef', 'd8237132-e481-4426-8e6f-80b427f20645'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:49 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.935s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:49 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:49 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Deleted volume successfully. Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c150d206-d5f2-45f8-9860-98522f108947 tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-a16e77bc-1c3a-47ea-b153-15dfd9a8f2b2-delete_volume" released by "delete_volume" :: held 5.807s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:49 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c" returned: 0 in 14.653s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81da27b-35df-4990-945e-e5a974ef620b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:49 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.576s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:49 devstack cinder-volume[86888]: DEBUG cinder.manager [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:49 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:49 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:50 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Deleted volume successfully. Sep 28 15:04:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-c8948959-69ef-4c41-86d4-f7ee3a52bef5 req-886fbf3d-3eff-4358-a2e8-3cf3cb0bc62a tempest-ServerActionsTestOtherA-1898348918 None] Lock "cinder-16253157-827e-48d1-b728-7c57e72e3c69-delete_volume" released by "delete_volume" :: held 7.364s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:51 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 1.480s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532, size 1024.00 MB, duration 14.66 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:04:51 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Converted 1024.00 MB image at 69.87 MB/s Sep 28 15:04:51 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c is being set with open permissions: ugo+rw Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:51 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c Sep 28 15:04:51 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:51 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c" returned: 0 in 0.432s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-9a0d60c5-a092-4f27-8e61-73cb3524d44c" released by "_copy_volume_from_snapshot" :: held 18.138s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "cinder-quobyte-db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Deleting offline snapshot db6bf5a2-d394-4d22-bf5e-8b0aa585bccd of volume 0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] snapshot_file for this snap is: volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7350511c-9f05-4967-a4db-e5e81b517c0b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:51 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd Sep 28 15:04:51 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:52 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" returned: 0 in 0.788s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893d6bc-323e-4fc3-aac2-4f36b1db13a5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:52 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:52 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 0.563s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd Sep 28 15:04:53 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" returned: 0 in 0.467s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd Sep 28 15:04:53 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532.db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-db6bf5a2-d394-4d22-bf5e-8b0aa585bccd" released by "_delete_snapshot" :: held 2.269s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.725s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.480s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-927963455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bff1227-59f6-4b96-8e2c-bb24b1a8db0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff18333db5064d57952b8e3f4ad5b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:29Z,use_quota=True,user_id='e94914b5e2934313aff747cab6cf70ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Creating volume 2bff1227-59f6-4b96-8e2c-bb24b1a8db0d {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:04:53 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:04:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d 1073741824 Sep 28 15:04:53 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239a217b-e8e6-4603-a9fc-dd5ba8728afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c', 'volume_size': 2, 'source_volid': '0eaf5691-0bf3-4ba1-a3b9-7503aec4a532', 'source_volstatus': 'available'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690db545-ffba-493b-a462-1d6f359a1cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Volume volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c (9a0d60c5-a092-4f27-8e61-73cb3524d44c): created successfully Sep 28 15:04:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690db545-ffba-493b-a462-1d6f359a1cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Flow 'volume_create_manager' (8e9b1780-b885-4cd4-b060-62ab9139f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a21bd440-bd2a-4302-9de6-5f703a513519 tempest-VolumesCloneTest-1646098129 None] Created volume successfully. Sep 28 15:04:54 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d 1073741824" returned: 0 in 0.645s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:54 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d Sep 28 15:04:54 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:55 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbd3165-28e2-40d4-b274-3cb93c9d4e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d079620-5fd8-4c66-94d2-a5ea6c94fbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:55 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Volume volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d (2bff1227-59f6-4b96-8e2c-bb24b1a8db0d): created successfully Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d079620-5fd8-4c66-94d2-a5ea6c94fbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Flow 'volume_create_manager' (8bdf9682-70bc-4e27-a562-eb37a8be9697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "cinder-9a0d60c5-a092-4f27-8e61-73cb3524d44c-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fe76cdbd-a0d6-4d10-a91c-8d4d6e6852d3 tempest-VolumesTestJSON-1310980074 None] Created volume successfully. Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-9a0d60c5-a092-4f27-8e61-73cb3524d44c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "cinder-quobyte-9a0d60c5-a092-4f27-8e61-73cb3524d44c" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-9a0d60c5-a092-4f27-8e61-73cb3524d44c" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b18baf-cb60-4a5f-8515-3a9c51a27ba5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:55 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c Sep 28 15:04:55 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:56 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c" returned: 0 in 0.713s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:56 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c Sep 28 15:04:56 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:56 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9a0d60c5-a092-4f27-8e61-73cb3524d44c" returned: 0 in 0.693s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-9a0d60c5-a092-4f27-8e61-73cb3524d44c" released by "delete_volume" :: held 1.486s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Created reservations ['1bd31527-ffaf-4c6a-a87d-a37f3591403a', '551b83a5-3079-42ef-90a7-86eeff3d4972', '2ccaf34a-b9ee-4d49-af0f-eccb34fe7fa5', '815f73f3-c94d-4141-ba3f-e3da6c04a0a8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Flow 'volume_create_manager' (41aeb9a4-ce5e-49aa-919c-50803de5da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24143f5d-eebc-4250-86a6-8f998eeb7447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24143f5d-eebc-4250-86a6-8f998eeb7447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1326454398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ced8477-a296-49f2-aec3-5f86766c3442,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff18333db5064d57952b8e3f4ad5b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:57Z,use_quota=True,user_id='e94914b5e2934313aff747cab6cf70ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f1d2a0-d226-4924-abea-c49b4e9f41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f1d2a0-d226-4924-abea-c49b4e9f41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84eadb45-876b-44e9-b767-96974dd9edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84eadb45-876b-44e9-b767-96974dd9edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ced8477-a296-49f2-aec3-5f86766c3442', 'volume_name': 'volume-1ced8477-a296-49f2-aec3-5f86766c3442', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbda115-b592-4efd-be4d-919b0262cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbda115-b592-4efd-be4d-919b0262cf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa40d0e-7d3d-4635-a91e-304d90e84f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Volume 1ced8477-a296-49f2-aec3-5f86766c3442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ced8477-a296-49f2-aec3-5f86766c3442', 'volume_size': 1} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1326454398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ced8477-a296-49f2-aec3-5f86766c3442,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff18333db5064d57952b8e3f4ad5b58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:57Z,use_quota=True,user_id='e94914b5e2934313aff747cab6cf70ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Creating volume 1ced8477-a296-49f2-aec3-5f86766c3442 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:04:57 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:57 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 1073741824 Sep 28 15:04:57 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:57 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:57 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:57 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.414s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Deleted volume successfully. Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22654f79-bca5-483b-9f3f-ac54e8948009 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-9a0d60c5-a092-4f27-8e61-73cb3524d44c-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:57 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 1073741824" returned: 0 in 0.836s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "cinder-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 Sep 28 15:04:58 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "cinder-quobyte-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[90803833-3cd0-40c8-85ae-0ded7d50f385]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:58 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442" returned: 0 in 0.455s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa40d0e-7d3d-4635-a91e-304d90e84f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ced8477-a296-49f2-aec3-5f86766c3442', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc53594-3071-4e34-adc9-f3ba6380a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Volume volume-1ced8477-a296-49f2-aec3-5f86766c3442 (1ced8477-a296-49f2-aec3-5f86766c3442): created successfully Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc53594-3071-4e34-adc9-f3ba6380a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Flow 'volume_create_manager' (41aeb9a4-ce5e-49aa-919c-50803de5da28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a693d83e-673a-4029-80e0-0c7d47b61c82 tempest-VolumesTestJSON-1310980074 None] Created volume successfully. Sep 28 15:04:58 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 0.470s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532 Sep 28 15:04:58 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" returned: 0 in 0.339s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-quobyte-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532" released by "delete_volume" :: held 0.962s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Created reservations ['b64542bf-2dff-41f0-aada-c228bbdc9935', '1576a5a6-6615-4c49-9c16-1712a982408a', '7c830189-9b58-40b9-bfed-e30f0e1352bb', '24ed6fdb-0795-4820-8e1e-28943b45dc26'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:59 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:04:59 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:59 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.376s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Deleted volume successfully. Sep 28 15:04:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b9aafa1d-ac30-4a6d-a459-e6d7e81c5619 tempest-VolumesCloneTest-1646098129 None] Lock "cinder-0eaf5691-0bf3-4ba1-a3b9-7503aec4a532-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Acquiring lock "cinder-1ced8477-a296-49f2-aec3-5f86766c3442-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Lock "cinder-1ced8477-a296-49f2-aec3-5f86766c3442-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Acquiring lock "cinder-quobyte-1ced8477-a296-49f2-aec3-5f86766c3442" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Lock "cinder-quobyte-1ced8477-a296-49f2-aec3-5f86766c3442" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:00 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcfb199-2e44-4e20-87d6-4ed4b1a40ce0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:00 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 Sep 28 15:05:00 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:01 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442" returned: 0 in 0.586s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:01 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442 Sep 28 15:05:01 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:01 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1ced8477-a296-49f2-aec3-5f86766c3442" returned: 0 in 0.353s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Lock "cinder-quobyte-1ced8477-a296-49f2-aec3-5f86766c3442" released by "delete_volume" :: held 1.037s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Created reservations ['f31aca8c-0aa0-419a-a294-ccefc4216a11', '7556cd54-65e1-414d-8a90-56b97413e65b', 'c2f7eb54-57a7-41cf-9f93-16fb8a19d40b', 'eb1d4b0d-7030-4730-972b-a863747efae8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:01 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:05:01 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:02 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Deleted volume successfully. Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b0dd8f6e-5983-401d-b846-48e7d987b16e tempest-VolumesTestJSON-1310980074 None] Lock "cinder-1ced8477-a296-49f2-aec3-5f86766c3442-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Acquiring lock "cinder-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Lock "cinder-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Acquiring lock "cinder-quobyte-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Lock "cinder-quobyte-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0162738-4045-40ef-9ee8-122a1ab2982d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:02 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d Sep 28 15:05:02 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:03 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d" returned: 0 in 0.505s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d Sep 28 15:05:03 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:03 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d" returned: 0 in 0.348s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Lock "cinder-quobyte-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d" released by "delete_volume" :: held 0.924s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Created reservations ['6471dd70-1f6f-4ff8-8144-1c9d22d10bcf', 'a2426dd2-5ac5-4fdc-9a0c-b4c49c7a82a4', '4d01003f-2039-4645-b12f-11f45e3b4668', 'cdb015ad-c47b-4e8f-a7d1-9871ca716fee'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:05:03 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:04 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.387s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Deleted volume successfully. Sep 28 15:05:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6db850-3ea9-4dd3-a3ef-191bcec1001d tempest-VolumesTestJSON-1310980074 None] Lock "cinder-2bff1227-59f6-4b96-8e2c-bb24b1a8db0d-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "cinder-823d31cc-9c4b-4380-a233-08da251a47e7-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Lock "cinder-823d31cc-9c4b-4380-a233-08da251a47e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "cinder-quobyte-823d31cc-9c4b-4380-a233-08da251a47e7" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Lock "cinder-quobyte-823d31cc-9c4b-4380-a233-08da251a47e7" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f47dd6-cd81-4614-8865-fe10c192a29c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:05 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 Sep 28 15:05:05 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:05 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7" returned: 0 in 0.705s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:05 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7 Sep 28 15:05:05 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Flow 'volume_create_manager' (f64e9ad2-cb2f-4b9a-87be-88b4bbc9ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66314c0c-d992-4242-a5b7-19475a96d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66314c0c-d992-4242-a5b7-19475a96d071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1181904135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de1b5d8-3d95-48ca-94c4-f318d42dd852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c186961fdc064e7692dce45ad6a84ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:06Z,use_quota=True,user_id='50fd7b75e5cd40f798e3df226dce9885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac85467-cf21-44b3-934f-ea838782fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac85467-cf21-44b3-934f-ea838782fb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957ff0bf-7311-43dc-b965-52126ceaa1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957ff0bf-7311-43dc-b965-52126ceaa1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de1b5d8-3d95-48ca-94c4-f318d42dd852', 'volume_name': 'volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852', 'volume_size': 2}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40555167-bfce-4e70-9ffd-8e0f2eba7409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40555167-bfce-4e70-9ffd-8e0f2eba7409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e04fd3-a09b-4d59-ac72-fc2b882259a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:06 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Volume 0de1b5d8-3d95-48ca-94c4-f318d42dd852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852', 'volume_size': 2} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1181904135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de1b5d8-3d95-48ca-94c4-f318d42dd852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c186961fdc064e7692dce45ad6a84ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:06Z,use_quota=True,user_id='50fd7b75e5cd40f798e3df226dce9885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Creating volume 0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:05:06 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 2147483648 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:06 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 2147483648 Sep 28 15:05:06 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:06 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-823d31cc-9c4b-4380-a233-08da251a47e7" returned: 0 in 0.479s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Lock "cinder-quobyte-823d31cc-9c4b-4380-a233-08da251a47e7" released by "delete_volume" :: held 1.276s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Created reservations ['a2629ff9-b07c-4528-b50f-b4e3e54682c1', '720f65a5-264d-4216-9413-500ac7a98b24', 'a1f08b97-6bdd-4d02-8e26-e69cb0912960', 'abb69309-52bf-4f2b-80dc-24e0ee9f7533'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:06 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:05:06 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:07 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.408s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:07 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Deleted volume successfully. Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 2147483648" returned: 0 in 0.880s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ce014355-ea34-45a4-b334-4a06e9bb0318 tempest-VolumesTestJSON-1310980074 None] Lock "cinder-823d31cc-9c4b-4380-a233-08da251a47e7-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:07 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 Sep 28 15:05:07 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:07 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852" returned: 0 in 0.406s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e04fd3-a09b-4d59-ac72-fc2b882259a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852', 'volume_size': 2}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438c4fc1-8542-4121-bb56-ef75d16ac618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Volume volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 (0de1b5d8-3d95-48ca-94c4-f318d42dd852): created successfully Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438c4fc1-8542-4121-bb56-ef75d16ac618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Flow 'volume_create_manager' (f64e9ad2-cb2f-4b9a-87be-88b4bbc9ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-23a11e9f-5841-4182-8481-f8a9434e3e35 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Created volume successfully. Sep 28 15:05:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Creating offline snapshot f00a17da-b6a5-4ec9-95d9-ae6814c5d29c of volume 0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b0133-acb4-47c1-b135-c87dafa6bdc7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:08 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 Sep 28 15:05:08 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:09 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852" returned: 0 in 0.528s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c 2G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:09 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c 2G Sep 28 15:05:09 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:09 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c 2G" returned: 0 in 0.720s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:09 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c Sep 28 15:05:09 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:10 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" returned: 0 in 0.465s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:10 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c is being set with open permissions: ugo+rw Sep 28 15:05:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:10 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c Sep 28 15:05:10 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:10 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" returned: 0 in 0.397s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:10 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info Sep 28 15:05:10 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info" returned: 0 in 0.317s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:11 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info is being set with open permissions: ugo+rw Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:11 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info Sep 28 15:05:11 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.info" returned: 0 in 0.312s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5e99af3c-453d-4dc8-b80a-e96dbdd909dd tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Create snapshot completed successfully Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "cinder-f00a17da-b6a5-4ec9-95d9-ae6814c5d29c-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-f00a17da-b6a5-4ec9-95d9-ae6814c5d29c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "cinder-quobyte-0de1b5d8-3d95-48ca-94c4-f318d42dd852" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-quobyte-0de1b5d8-3d95-48ca-94c4-f318d42dd852" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "cinder-quobyte-f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-quobyte-f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Deleting offline snapshot f00a17da-b6a5-4ec9-95d9-ae6814c5d29c of volume 0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] snapshot_file for this snap is: volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1863ff5-f45f-4e7f-afb2-d174e8271537]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:12 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c Sep 28 15:05:12 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:12 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" returned: 0 in 0.793s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:12 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266b55a-ef3d-46ec-b627-e88c6b1b6b26]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:12 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 Sep 28 15:05:12 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:13 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852" returned: 0 in 0.552s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c Sep 28 15:05:13 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Flow 'volume_create_manager' (4d7bf5e3-0e6d-4581-8358-ebb31a95e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24c5b68-a2db-44ba-8b6f-612bfc6a5b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24c5b68-a2db-44ba-8b6f-612bfc6a5b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1752878953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86991283-d395-48a4-9bbf-1e6b2dbd61df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccf22005b4f483ebadbe4df128993c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:14Z,use_quota=True,user_id='c78a4530f2b54fffbb75db27d6065200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b3310e-c2e5-4d2e-a42d-62707ca21154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b3310e-c2e5-4d2e-a42d-62707ca21154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b6f9ce-116c-4a94-b8e7-18431e10cb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b6f9ce-116c-4a94-b8e7-18431e10cb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86991283-d395-48a4-9bbf-1e6b2dbd61df', 'volume_name': 'volume-86991283-d395-48a4-9bbf-1e6b2dbd61df', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce67f43-3cfb-4ee3-8bd4-c41f98c2b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce67f43-3cfb-4ee3-8bd4-c41f98c2b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98528a65-561d-41cb-b6be-3df95eabc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:13 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Volume 86991283-d395-48a4-9bbf-1e6b2dbd61df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86991283-d395-48a4-9bbf-1e6b2dbd61df', 'volume_size': 1} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1752878953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86991283-d395-48a4-9bbf-1e6b2dbd61df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccf22005b4f483ebadbe4df128993c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:14Z,use_quota=True,user_id='c78a4530f2b54fffbb75db27d6065200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Creating volume 86991283-d395-48a4-9bbf-1e6b2dbd61df {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:05:13 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df 1073741824 Sep 28 15:05:13 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:13 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" returned: 0 in 0.520s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c Sep 28 15:05:13 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e1e79bc6-97aa-4749-8300-960d7c3f7e66 tempest-GroupSnapshotsV319Test-850384947 None] Group tempest-GroupSnapshotsV319Test-Group-199695775: creating Sep 28 15:05:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e1e79bc6-97aa-4749-8300-960d7c3f7e66 tempest-GroupSnapshotsV319Test-850384947 None] Group tempest-GroupSnapshotsV319Test-Group-199695775: created successfully Sep 28 15:05:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e1e79bc6-97aa-4749-8300-960d7c3f7e66 tempest-GroupSnapshotsV319Test-850384947 None] Create group completed successfully. Sep 28 15:05:14 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852.f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" returned: 0 in 0.463s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-quobyte-f00a17da-b6a5-4ec9-95d9-ae6814c5d29c" released by "_delete_snapshot" :: held 2.516s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-quobyte-0de1b5d8-3d95-48ca-94c4-f318d42dd852" released by "delete_snapshot" :: held 2.546s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:14 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df 1073741824" returned: 0 in 0.679s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:14 devstack cinder-volume[86888]: WARNING cinder.quota [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Created reservations ['d30bf653-45b7-4f69-8724-4d0cfeb7c5bf', '45470fbf-5639-4194-a1b4-33ecdc19ea05', 'c047a6d9-8644-4323-b622-81804024fbd4', '87af3a32-d13b-4294-ac77-5760ae5c8c21'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:14 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df Sep 28 15:05:14 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Delete snapshot completed successfully. Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff8ff8b0-f244-47f1-96c9-962c6591b689 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-f00a17da-b6a5-4ec9-95d9-ae6814c5d29c-delete_snapshot" released by "delete_snapshot" :: held 2.787s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:14 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df" returned: 0 in 0.312s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98528a65-561d-41cb-b6be-3df95eabc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86991283-d395-48a4-9bbf-1e6b2dbd61df', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1056566c-f1c3-4536-b755-c934f4040947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Volume volume-86991283-d395-48a4-9bbf-1e6b2dbd61df (86991283-d395-48a4-9bbf-1e6b2dbd61df): created successfully Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1056566c-f1c3-4536-b755-c934f4040947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Flow 'volume_create_manager' (4d7bf5e3-0e6d-4581-8358-ebb31a95e784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f4e511ab-b7f7-47ac-9ec2-f21d55829def tempest-AttachVolumeNegativeTest-958876162 None] Created volume successfully. Sep 28 15:05:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "cinder-0de1b5d8-3d95-48ca-94c4-f318d42dd852-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-0de1b5d8-3d95-48ca-94c4-f318d42dd852-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "cinder-quobyte-0de1b5d8-3d95-48ca-94c4-f318d42dd852" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-quobyte-0de1b5d8-3d95-48ca-94c4-f318d42dd852" acquired by "delete_volume" :: waited 0.052s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:15 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed168c4-1762-4bcc-8c69-fe7b1efcfb69]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:16 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 Sep 28 15:05:16 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Flow 'volume_create_manager' (a6caead9-4b56-4baa-945d-bdeac9c29421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2c3e64-7336-4f20-a5e1-bd7e357a795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2c3e64-7336-4f20-a5e1-bd7e357a795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-771853837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83cff934-f3de-43de-ab7b-51df2e82ad55,host='devstack@QuobyteHD#QuobyteHD',id=cdf948a0-8254-45dc-85f8-0a0aba34f1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d777b7a73d541099b218c6e1a84437b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:16Z,use_quota=True,user_id='3df288259408473784971d0a6820e624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6943eb4a-c5fe-4427-a37b-8cd24e674a7a),volume_type_id=6943eb4a-c5fe-4427-a37b-8cd24e674a7a)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a47ed9-4a16-434c-868e-9754e4bb6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a47ed9-4a16-434c-868e-9754e4bb6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223ceea1-a299-46a0-b63d-1c38f492b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223ceea1-a299-46a0-b63d-1c38f492b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf948a0-8254-45dc-85f8-0a0aba34f1a6', 'volume_name': 'volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cd3774-57bd-43d2-8b31-0d5c5c3df6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cd3774-57bd-43d2-8b31-0d5c5c3df6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c46d46-27ea-47d6-bd58-ccd2f9b71e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:16 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Volume cdf948a0-8254-45dc-85f8-0a0aba34f1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6', 'volume_size': 1} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83cff934-f3de-43de-ab7b-51df2e82ad55,created_at=2026-09-28T13:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-771853837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83cff934-f3de-43de-ab7b-51df2e82ad55,host='devstack@QuobyteHD#QuobyteHD',id=cdf948a0-8254-45dc-85f8-0a0aba34f1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d777b7a73d541099b218c6e1a84437b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:16Z,use_quota=True,user_id='3df288259408473784971d0a6820e624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6943eb4a-c5fe-4427-a37b-8cd24e674a7a),volume_type_id=6943eb4a-c5fe-4427-a37b-8cd24e674a7a)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Creating volume cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:05:16 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:16 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 1073741824 Sep 28 15:05:16 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:16 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852" returned: 0 in 0.828s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:16 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852 Sep 28 15:05:16 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0de1b5d8-3d95-48ca-94c4-f318d42dd852" returned: 0 in 0.410s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-quobyte-0de1b5d8-3d95-48ca-94c4-f318d42dd852" released by "delete_volume" :: held 1.391s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Created reservations ['6469f29d-68ec-4a53-a3e4-41360fc8d585', '18ba255f-82ea-438b-91b1-ee20d3248ea8', '36413041-9fa3-4a0f-ae12-5a83586990c7', '6cbd8cde-320a-441d-ba0c-7af56d9eaed7'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:17 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 1073741824" returned: 0 in 0.829s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:05:17 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 Sep 28 15:05:17 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:17 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" returned: 0 in 0.371s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.272s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c46d46-27ea-47d6-bd58-ccd2f9b71e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:17 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffa911a-c81b-4364-b779-2a6525a4ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf227ad-dd3d-4d1c-ba11-2420c2273525]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.479s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Deleted volume successfully. Sep 28 15:05:17 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Volume volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 (cdf948a0-8254-45dc-85f8-0a0aba34f1a6): created successfully Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffa911a-c81b-4364-b779-2a6525a4ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Flow 'volume_create_manager' (a6caead9-4b56-4baa-945d-bdeac9c29421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4c95ddb6-1adb-47f6-9038-d83e3a636bfe tempest-GroupSnapshotsV319Test-850384947 None] Created volume successfully. Sep 28 15:05:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9c11c9b2-6495-4d42-8dc0-6d97fad2b3c4 tempest-VolumesSnapshotNegativeTestJSON-2107654363 None] Lock "cinder-0de1b5d8-3d95-48ca-94c4-f318d42dd852-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:18 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df Sep 28 15:05:18 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:18 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df" returned: 0 in 0.546s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.604s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-86991283-d395-48a4-9bbf-1e6b2dbd61df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '126989ea-bf00-49ac-a731-c30ba5a0fbf9', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:05:18 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-0f87cd91-6fcc-43ab-9756-36cc70eb65e6 req-92f51798-f2e3-465e-8811-4fa0695527ae tempest-AttachVolumeNegativeTest-958876162 None] attachment_update completed successfully. Sep 28 15:05:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] GroupSnapshot 357ff4ee-8ce4-4ff3-8a03-efb4d314aa80: creating. Sep 28 15:05:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Group snapshot 357ff4ee-8ce4-4ff3-8a03-efb4d314aa80: creating. {{(pid=86888) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:05:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Creating offline snapshot 9adfb521-c7b6-4fd9-b540-1f12f41a1b9b of volume cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd9aab-81d3-4113-adfc-cdb17df1ea91]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 Sep 28 15:05:19 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b 1G Sep 28 15:05:20 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b 1G" returned: 0 in 0.732s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b Sep 28 15:05:20 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" returned: 0 in 0.531s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b Sep 28 15:05:21 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" returned: 0 in 0.435s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:22 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info Sep 28 15:05:22 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info" returned: 0 in 0.488s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:05:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:22 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info Sep 28 15:05:22 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-8ed97437-26fc-4f8c-ace2-82e149a89908 req-d5ec3c39-655c-4a03-826f-1b92480a1d67 tempest-AttachVolumeNegativeTest-958876162 None] Terminate volume connection completed successfully. Sep 28 15:05:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-8ed97437-26fc-4f8c-ace2-82e149a89908 req-d5ec3c39-655c-4a03-826f-1b92480a1d67 tempest-AttachVolumeNegativeTest-958876162 None] Deleting attachment 126989ea-bf00-49ac-a731-c30ba5a0fbf9. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:22 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.info" returned: 0 in 0.502s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.486s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a0b6297d-c5a7-4b03-a767-a92a17f02b9d tempest-GroupSnapshotsV319Test-850384947 None] group_snapshot 357ff4ee-8ce4-4ff3-8a03-efb4d314aa80: created successfully Sep 28 15:05:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] group_snapshot 357ff4ee-8ce4-4ff3-8a03-efb4d314aa80: deleting Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] group_snapshot 357ff4ee-8ce4-4ff3-8a03-efb4d314aa80: deleting {{(pid=86888) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=83,cinder:INSERT=26,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "cinder-quobyte-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Lock "cinder-quobyte-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "cinder-quobyte-9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Lock "cinder-quobyte-9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Deleting offline snapshot 9adfb521-c7b6-4fd9-b540-1f12f41a1b9b of volume cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] snapshot_file for this snap is: volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c326cac-6847-4df0-ad86-b6e955614739]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b Sep 28 15:05:25 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" returned: 0 in 0.718s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd35a8-dc19-48b5-be15-f3909fb16816]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 Sep 28 15:05:25 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:26 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" returned: 0 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b Sep 28 15:05:26 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:26 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" returned: 0 in 0.700s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b Sep 28 15:05:26 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6.9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" returned: 0 in 0.545s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Lock "cinder-quobyte-9adfb521-c7b6-4fd9-b540-1f12f41a1b9b" released by "_delete_snapshot" :: held 2.626s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Lock "cinder-quobyte-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" released by "delete_snapshot" :: held 2.666s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:27 devstack cinder-volume[86888]: WARNING cinder.quota [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1155606974 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1155606974, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:27 devstack cinder-volume[86888]: WARNING cinder.quota [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1155606974 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1155606974, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:27 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] Created reservations ['e706ade8-fbb7-4ebc-8319-ff7a060fcf4a', '1654e6b2-7821-4bb7-85fc-9eff2be058cd', '3d20869d-ed9a-414a-8d42-cfef4e43a98c', '3ffd31b7-3cea-476c-9912-673ffe1d8a50'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1de6e476-2f17-4968-8e0d-051f1cc62623 tempest-GroupSnapshotsV319Test-850384947 None] group_snapshot 357ff4ee-8ce4-4ff3-8a03-efb4d314aa80: deleted successfully Sep 28 15:05:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "cinder-quobyte-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Lock "cinder-quobyte-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" acquired by "delete_volume" :: waited 0.045s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b40d11-baf4-49b1-a7bc-69b530196d91]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:29 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 Sep 28 15:05:29 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:30 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" returned: 0 in 0.624s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:30 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6 Sep 28 15:05:30 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:30 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" returned: 0 in 0.525s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Lock "cinder-quobyte-cdf948a0-8254-45dc-85f8-0a0aba34f1a6" released by "delete_volume" :: held 1.336s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Created reservations ['d2b9bb69-c60e-4ad2-b37f-9071afeaaa0f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:30 devstack cinder-volume[86888]: WARNING cinder.quota [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1155606974 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1155606974, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Created reservations ['daf2db7f-0162-486f-9774-8c3c51a4259d', '4b5da3cb-ce17-4259-b0c8-fb7332e44e92', '54202878-a100-42a1-a817-e92d1581475d', '98f9bfe4-7848-4021-9235-02b4a20f1712'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:30 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:05:30 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:31 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b6b56dd9-0ee2-469e-86c2-b6655c17af9b tempest-GroupSnapshotsV319Test-850384947 None] Delete group completed successfully. Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:40 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:05:40 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=97,cinder:UPDATE=106,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=17,cinder:SELECT=14,cinder:INSERT=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:40 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.401s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 28 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:05:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:06:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0341af64-570f-49f0-a290-3fcab9e2548f tempest-GroupsV314Test-467076427 None] Group tempest-GroupsV314Test-Group-667211227: creating Sep 28 15:06:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0341af64-570f-49f0-a290-3fcab9e2548f tempest-GroupsV314Test-467076427 None] Group tempest-GroupsV314Test-Group-667211227: created successfully Sep 28 15:06:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0341af64-570f-49f0-a290-3fcab9e2548f tempest-GroupsV314Test-467076427 None] Create group completed successfully. Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Flow 'volume_create_manager' (63b2fd90-ab0e-4a1e-952a-95668a16d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dea774-476e-4b8c-8566-1e611646e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dea774-476e-4b8c-8566-1e611646e272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067327486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbb67ae0-20e3-4bef-92de-b27f35a7b3c8,host='devstack@QuobyteHD#QuobyteHD',id=9bc9af12-41bc-42da-9bf9-0634c0867f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b7fa74c8054286bdf4fb523ff9b2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:14Z,use_quota=True,user_id='2806bf69d35e4b75a6668f60ee57947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11c6fccd-0fc5-4392-b7e0-2f401782010c),volume_type_id=11c6fccd-0fc5-4392-b7e0-2f401782010c)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aed5c27-d9af-442e-861b-ebc47838e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aed5c27-d9af-442e-861b-ebc47838e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423c2236-674b-438e-bbf6-0ef7cfae2797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423c2236-674b-438e-bbf6-0ef7cfae2797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc9af12-41bc-42da-9bf9-0634c0867f33', 'volume_name': 'volume-9bc9af12-41bc-42da-9bf9-0634c0867f33', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bee7515-fc8b-4813-a1d7-1481d799d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bee7515-fc8b-4813-a1d7-1481d799d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94c78f9-06fb-485e-8415-4efd14f22f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Volume 9bc9af12-41bc-42da-9bf9-0634c0867f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc9af12-41bc-42da-9bf9-0634c0867f33', 'volume_size': 1} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fbb67ae0-20e3-4bef-92de-b27f35a7b3c8,created_at=2026-09-28T13:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067327486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbb67ae0-20e3-4bef-92de-b27f35a7b3c8,host='devstack@QuobyteHD#QuobyteHD',id=9bc9af12-41bc-42da-9bf9-0634c0867f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b7fa74c8054286bdf4fb523ff9b2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:14Z,use_quota=True,user_id='2806bf69d35e4b75a6668f60ee57947b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11c6fccd-0fc5-4392-b7e0-2f401782010c),volume_type_id=11c6fccd-0fc5-4392-b7e0-2f401782010c)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Creating volume 9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:06:14 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:06:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:14 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 1073741824 Sep 28 15:06:14 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:15 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 1073741824" returned: 0 in 1.366s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:16 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:06:16 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:16 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 0.857s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:06:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94c78f9-06fb-485e-8415-4efd14f22f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc9af12-41bc-42da-9bf9-0634c0867f33', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98aa04a-d6f9-4009-aaa3-982c88f1aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:17 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Volume volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 (9bc9af12-41bc-42da-9bf9-0634c0867f33): created successfully Sep 28 15:06:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98aa04a-d6f9-4009-aaa3-982c88f1aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Flow 'volume_create_manager' (63b2fd90-ab0e-4a1e-952a-95668a16d812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-03519b57-bc53-4a1e-a38e-6ea3b8605592 tempest-GroupsV314Test-467076427 None] Created volume successfully. Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Flow 'volume_create_manager' (38703128-9019-437f-9aae-d05bd58a2be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39566f95-b352-4d27-97d0-f859a54dd75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39566f95-b352-4d27-97d0-f859a54dd75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1084148496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2492c5-e160-40a8-8c8a-ff1580d6a83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d026f4e7b9e443e9998437246a062b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:19Z,use_quota=True,user_id='1d45eda8d37a477e9eebdece0f5099d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25be3bf7-55fc-4c84-ae4d-cdd255c0c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25be3bf7-55fc-4c84-ae4d-cdd255c0c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6b3810-ee6a-42dc-a279-9e3baeabebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6b3810-ee6a-42dc-a279-9e3baeabebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2492c5-e160-40a8-8c8a-ff1580d6a83b', 'volume_name': 'volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb49f1cd-e3f6-40ca-8bf7-217b9a6ecabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb49f1cd-e3f6-40ca-8bf7-217b9a6ecabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b937b7-86f7-4ab4-a900-3443adec2393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:19 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Volume 3a2492c5-e160-40a8-8c8a-ff1580d6a83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b', 'volume_size': 1} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1084148496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2492c5-e160-40a8-8c8a-ff1580d6a83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d026f4e7b9e443e9998437246a062b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:19Z,use_quota=True,user_id='1d45eda8d37a477e9eebdece0f5099d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Creating volume 3a2492c5-e160-40a8-8c8a-ff1580d6a83b {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:06:19 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:06:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b 1073741824 Sep 28 15:06:19 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:20 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b 1073741824" returned: 0 in 1.056s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:20 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b Sep 28 15:06:20 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:21 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b" returned: 0 in 0.349s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.209s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:21 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Cloning volume 9bc9af12-41bc-42da-9bf9-0634c0867f33 to volume 1d594fa0-f84a-474d-9a5c-826a722f7b80 Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b937b7-86f7-4ab4-a900-3443adec2393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3f0c7b-5995-4587-942b-b72c1f9219a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:21 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Volume volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b (3a2492c5-e160-40a8-8c8a-ff1580d6a83b): created successfully Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3f0c7b-5995-4587-942b-b72c1f9219a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Flow 'volume_create_manager' (38703128-9019-437f-9aae-d05bd58a2be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Creating offline snapshot 148446d9-bf3e-407c-9f8e-8a99a5fa0005 of volume 9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0195d1b9-55bd-4e23-9d89-41d6b0780f1c tempest-ServerRescueNegativeTestJSON-23880896 None] Created volume successfully. Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c2b8f1-c1c4-4413-a42d-f3fd6b727d75]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:21 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:06:21 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:22 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 1.026s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:22 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 1G Sep 28 15:06:22 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:24 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 1G" returned: 0 in 1.663s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:24 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 Sep 28 15:06:24 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:25 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005" returned: 0 in 0.822s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:25 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:25 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 Sep 28 15:06:25 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:25 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005" returned: 0 in 0.736s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:25 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info Sep 28 15:06:25 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:26 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info Sep 28 15:06:26 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.info" returned: 0 in 0.433s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Acquiring lock "cinder-quobyte-1d594fa0-f84a-474d-9a5c-826a722f7b80" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-1d594fa0-f84a-474d-9a5c-826a722f7b80" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] snapshot: 148446d9-bf3e-407c-9f8e-8a99a5fa0005, volume: 1d594fa0-f84a-474d-9a5c-826a722f7b80, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:27 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2f9c87-cd79-498f-b281-40c6ba474649]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 Sep 28 15:06:27 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005" returned: 0 in 0.913s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc9af12-41bc-42da-9bf9-0634c0867f33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:06:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:06:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c16bde1-31bc-4f25-98dc-c4bc58823fa1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:28 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:06:28 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:29 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 1.137s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:29 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:06:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 Sep 28 15:06:29 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=5,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:40 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:06:40 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:42 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.437s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:42 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:42 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 28 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:06:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Flow 'volume_create_manager' (af2bf2cc-c3af-427f-a803-deb46af65da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275565c1-ae97-4950-b35d-dfd9402bba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275565c1-ae97-4950-b35d-dfd9402bba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1559839231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a195ba-74ef-4b35-8380-c24322768f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccf22005b4f483ebadbe4df128993c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:45Z,use_quota=True,user_id='c78a4530f2b54fffbb75db27d6065200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14020a55-51fb-4077-a52f-7f74e496bcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14020a55-51fb-4077-a52f-7f74e496bcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e650d0-dea4-457a-a26f-6b66c3307e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e650d0-dea4-457a-a26f-6b66c3307e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a195ba-74ef-4b35-8380-c24322768f9b', 'volume_name': 'volume-38a195ba-74ef-4b35-8380-c24322768f9b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99415886-c19b-47dd-8c18-62453719fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99415886-c19b-47dd-8c18-62453719fec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8636b65c-3bd8-4a50-be2f-6aecdb7d9b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Volume 38a195ba-74ef-4b35-8380-c24322768f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a195ba-74ef-4b35-8380-c24322768f9b', 'volume_size': 1} Sep 28 15:06:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:48 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80" returned: 0 in 18.905s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1185b80a-4689-4aab-9445-f19010da23bd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:48 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:06:48 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 1.055s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33, size 1024.00 MB, duration 18.91 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:06:49 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Converted 1024.00 MB image at 54.16 MB/s Sep 28 15:06:49 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:49 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 Sep 28 15:06:49 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80" returned: 0 in 0.494s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-1d594fa0-f84a-474d-9a5c-826a722f7b80" released by "_copy_volume_from_snapshot" :: held 22.824s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Acquiring lock "cinder-quobyte-148446d9-bf3e-407c-9f8e-8a99a5fa0005" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-148446d9-bf3e-407c-9f8e-8a99a5fa0005" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Deleting offline snapshot 148446d9-bf3e-407c-9f8e-8a99a5fa0005 of volume 9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] snapshot_file for this snap is: volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad55ae-4205-40f7-aee1-5a1d67c0e972]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 Sep 28 15:06:50 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:50 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005" returned: 0 in 0.670s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc9af12-41bc-42da-9bf9-0634c0867f33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff7d6f3-fc69-449b-bdba-9420822feca7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Acquiring lock "cinder-3a2492c5-e160-40a8-8c8a-ff1580d6a83b-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "cinder-3a2492c5-e160-40a8-8c8a-ff1580d6a83b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Acquiring lock "cinder-quobyte-3a2492c5-e160-40a8-8c8a-ff1580d6a83b" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "cinder-quobyte-3a2492c5-e160-40a8-8c8a-ff1580d6a83b" acquired by "delete_volume" :: waited 0.068s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:51 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780996c-a55f-4c41-9b56-4394f5173e28]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:51 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:06:51 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b Sep 28 15:06:51 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 1.206s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:51 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 Sep 28 15:06:51 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b" returned: 0 in 1.207s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b Sep 28 15:06:52 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005" returned: 0 in 0.793s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005 Sep 28 15:06:52 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3a2492c5-e160-40a8-8c8a-ff1580d6a83b" returned: 0 in 0.593s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "cinder-quobyte-3a2492c5-e160-40a8-8c8a-ff1580d6a83b" released by "delete_volume" :: held 1.972s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Created reservations ['28c360ba-7036-4eb9-9916-629e20d079f3', '055f9c96-e7e9-4f8a-9d2f-8aab9457533b', 'fbc169d8-e3d3-4f29-ad35-07ba64ec757a', '648bcfbe-2fca-47a6-9c66-0f0fde41129e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:06:53 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33.148446d9-bf3e-407c-9f8e-8a99a5fa0005" returned: 0 in 0.935s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-148446d9-bf3e-407c-9f8e-8a99a5fa0005" released by "_delete_snapshot" :: held 3.874s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 32.525s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.081s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1559839231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a195ba-74ef-4b35-8380-c24322768f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccf22005b4f483ebadbe4df128993c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:45Z,use_quota=True,user_id='c78a4530f2b54fffbb75db27d6065200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Creating volume 38a195ba-74ef-4b35-8380-c24322768f9b {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:06:53 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:06:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b 1073741824 Sep 28 15:06:54 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-61a41bb0-cc03-4bae-8d36-061741d4d997 tempest-GroupsV314Test-467076427 None] Create group from source-group-fbb67ae0-20e3-4bef-92de-b27f35a7b3c8 completed successfully. Sep 28 15:06:54 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.063s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Deleted volume successfully. Sep 28 15:06:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9f73ed5e-3530-48ff-a854-9c3860b679f8 tempest-ServerRescueNegativeTestJSON-23880896 None] Lock "cinder-3a2492c5-e160-40a8-8c8a-ff1580d6a83b-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:55 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b 1073741824" returned: 0 in 1.564s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b Sep 28 15:06:55 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b" returned: 0 in 0.665s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8636b65c-3bd8-4a50-be2f-6aecdb7d9b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a195ba-74ef-4b35-8380-c24322768f9b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1e2ae8-f982-417c-b33f-834b20c9ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Volume volume-38a195ba-74ef-4b35-8380-c24322768f9b (38a195ba-74ef-4b35-8380-c24322768f9b): created successfully Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1e2ae8-f982-417c-b33f-834b20c9ed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Flow 'volume_create_manager' (af2bf2cc-c3af-427f-a803-deb46af65da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-914703f3-b25d-435f-9f64-0c2a2a8a87d8 tempest-AttachVolumeNegativeTest-958876162 None] Created volume successfully. Sep 28 15:06:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Acquiring lock "cinder-quobyte-1d594fa0-f84a-474d-9a5c-826a722f7b80" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-1d594fa0-f84a-474d-9a5c-826a722f7b80" acquired by "delete_volume" :: waited 0.050s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[65427a86-e6d0-43a8-80d4-49aed5e6758d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 Sep 28 15:06:57 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80" returned: 0 in 1.165s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80 Sep 28 15:06:58 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:59 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d594fa0-f84a-474d-9a5c-826a722f7b80" returned: 0 in 0.447s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-1d594fa0-f84a-474d-9a5c-826a722f7b80" released by "delete_volume" :: held 1.779s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b88c3d-e3fe-4231-bdd2-a1f4d5396c5f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Created reservations ['29659ae9-80bc-4479-9b07-bd43e1a18919'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:59 devstack cinder-volume[86888]: WARNING cinder.quota [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-159335089 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-159335089, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:59 devstack cinder-volume[86888]: WARNING cinder.quota [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-159335089 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-159335089, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:59 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b Sep 28 15:06:59 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Created reservations ['449084f2-a398-46a0-9606-65582aec5f6c', '1b332dcb-aadf-46b8-ba1b-4353abec4e23', '92b88cb6-6f0e-4074-9527-4ff824b4c572', '7e9c6563-3d57-426e-a799-a061a40821e0'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:59 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:06:59 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:59 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b" returned: 0 in 0.890s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-38a195ba-74ef-4b35-8380-c24322768f9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2b89831-a0c1-4527-9d4b-e095c0b42135', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c8873d4e-bc11-42ed-b0cc-2f54ea91b6ab req-dfe74f17-33b9-445f-b959-ca7bb738091e tempest-AttachVolumeNegativeTest-958876162 None] attachment_update completed successfully. Sep 28 15:07:00 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.459s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4efa9907-f9c5-4992-8bf2-856bb68ec4b8 tempest-GroupsV314Test-467076427 None] Delete group completed successfully. Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Acquiring lock "cinder-quobyte-9bc9af12-41bc-42da-9bf9-0634c0867f33" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-9bc9af12-41bc-42da-9bf9-0634c0867f33" acquired by "delete_volume" :: waited 0.051s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ae9316-f526-4b56-b5b2-bb5e8b0c95bc]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:01 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:07:01 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:01 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 0.966s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:01 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33 Sep 28 15:07:01 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:02 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9bc9af12-41bc-42da-9bf9-0634c0867f33" returned: 0 in 0.732s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Lock "cinder-quobyte-9bc9af12-41bc-42da-9bf9-0634c0867f33" released by "delete_volume" :: held 1.938s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Created reservations ['0e9f566c-3533-4394-be97-691e3fe9493d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Created reservations ['582bdd95-6c96-43e4-94cd-5dbc451d869c', '58c2c30f-1c09-4f6f-a3b2-b035210286d9', '4e19afb9-d3ee-41d1-bccd-3b1dc1ed2c4a', 'b0b95aa8-6daf-4a8a-bbd8-f26a7f8375a9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:02 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:02 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:03 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.361s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:03 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5045a58c-a717-4b6d-a8de-b0c74833ef2f tempest-GroupsV314Test-467076427 None] Delete group completed successfully. Sep 28 15:07:05 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-f1779148-f45d-46af-a297-1f5527675135 req-1baeb262-b14e-46c2-a7f5-e90ea092d782 tempest-AttachVolumeNegativeTest-958876162 None] Terminate volume connection completed successfully. Sep 28 15:07:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-f1779148-f45d-46af-a297-1f5527675135 req-1baeb262-b14e-46c2-a7f5-e90ea092d782 tempest-AttachVolumeNegativeTest-958876162 None] Deleting attachment e2b89831-a0c1-4527-9d4b-e095c0b42135. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "cinder-38a195ba-74ef-4b35-8380-c24322768f9b-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-38a195ba-74ef-4b35-8380-c24322768f9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:12 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=30,cinder:UPDATE=38,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "cinder-quobyte-38a195ba-74ef-4b35-8380-c24322768f9b" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-quobyte-38a195ba-74ef-4b35-8380-c24322768f9b" acquired by "delete_volume" :: waited 0.057s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9023587b-c69d-403a-af53-513ce05c0d4c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:13 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b Sep 28 15:07:13 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b" returned: 0 in 0.816s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:14 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b Sep 28 15:07:14 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38a195ba-74ef-4b35-8380-c24322768f9b" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-quobyte-38a195ba-74ef-4b35-8380-c24322768f9b" released by "delete_volume" :: held 1.336s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Created reservations ['04ed2b4c-4b75-4f4d-9007-7467f50bf3ac', '6bb2b96d-6ead-478c-ba00-991fac34f51f', '24a65761-fd9a-4ca7-8e51-124d759296b6', '9b5db5e3-8de8-4822-9255-cf4926163f07'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:14 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:14 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:15 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.490s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:15 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Deleted volume successfully. Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fbf913b3-6616-4c38-8e7f-1ceeccface11 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-38a195ba-74ef-4b35-8380-c24322768f9b-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "cinder-86991283-d395-48a4-9bbf-1e6b2dbd61df-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-86991283-d395-48a4-9bbf-1e6b2dbd61df-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "cinder-quobyte-86991283-d395-48a4-9bbf-1e6b2dbd61df" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-quobyte-86991283-d395-48a4-9bbf-1e6b2dbd61df" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b28c496-e8a4-43bd-9d30-5152ae73e216]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df Sep 28 15:07:16 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df" returned: 0 in 0.737s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df Sep 28 15:07:16 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0132bad0-964f-4ad0-b995-59ae470cf4a3 tempest-GroupsV320Test-752701707 None] Group tempest-GroupsV320Test-Group-792523871: creating Sep 28 15:07:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0132bad0-964f-4ad0-b995-59ae470cf4a3 tempest-GroupsV320Test-752701707 None] Group tempest-GroupsV320Test-Group-792523871: created successfully Sep 28 15:07:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0132bad0-964f-4ad0-b995-59ae470cf4a3 tempest-GroupsV320Test-752701707 None] Create group completed successfully. Sep 28 15:07:17 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-86991283-d395-48a4-9bbf-1e6b2dbd61df" returned: 0 in 0.506s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-quobyte-86991283-d395-48a4-9bbf-1e6b2dbd61df" released by "delete_volume" :: held 1.327s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Created reservations ['49ad7603-43eb-44fa-9f5d-3f77762fb2d8', '952f449c-a04c-422e-a9de-348275e40ee3', '8a6556c3-ad86-4e10-9040-296b4ad12489', '985ee5cb-e561-4825-9dd7-8927226cfed7'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:17 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:17 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Flow 'volume_create_manager' (3011a6bf-cd0f-4988-aaac-57822de8d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a035059-47dc-4e69-bef8-620fcbd629e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a035059-47dc-4e69-bef8-620fcbd629e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-858669822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f64eda-34b6-47d8-85a9-c33b093e01a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e699e0439fe4fdb92dad3a8b481ca64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:17Z,use_quota=True,user_id='f26a4265089d488080d4d0f91529fecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2c4755-aa14-4663-b4e6-3a4dcf72548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2c4755-aa14-4663-b4e6-3a4dcf72548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7427c45c-6531-4d17-803f-98f89f0865f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7427c45c-6531-4d17-803f-98f89f0865f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f64eda-34b6-47d8-85a9-c33b093e01a3', 'volume_name': 'volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f64c7ef-1878-43d2-8f57-8074f6901a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f64c7ef-1878-43d2-8f57-8074f6901a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37263af4-7362-49ce-958f-f399e8901216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:17 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Volume b7f64eda-34b6-47d8-85a9-c33b093e01a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3', 'volume_size': 1} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-858669822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f64eda-34b6-47d8-85a9-c33b093e01a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e699e0439fe4fdb92dad3a8b481ca64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:17Z,use_quota=True,user_id='f26a4265089d488080d4d0f91529fecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Creating volume b7f64eda-34b6-47d8-85a9-c33b093e01a3 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:07:17 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:17 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 1073741824 Sep 28 15:07:17 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:17 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.427s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Deleted volume successfully. Sep 28 15:07:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af10378b-6b0a-4713-a94a-8e321bccb783 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-86991283-d395-48a4-9bbf-1e6b2dbd61df-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:18 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 1073741824" returned: 0 in 0.715s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:18 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 Sep 28 15:07:18 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Created reservations ['a3f99fa1-0a12-4354-93e4-6ef526fedb99'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "cinder-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:18 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:18 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:18 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "cinder-quobyte-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3" returned: 0 in 0.443s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37263af4-7362-49ce-958f-f399e8901216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6b6531-7eee-4c96-8f0d-38d83dd17d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-quobyte-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:19 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Volume volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 (b7f64eda-34b6-47d8-85a9-c33b093e01a3): created successfully Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6b6531-7eee-4c96-8f0d-38d83dd17d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Flow 'volume_create_manager' (3011a6bf-cd0f-4988-aaac-57822de8d22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a0c0c4-4c0e-4435-ac4f-424a036cc669]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b74c0a91-e7b7-45c7-be0c-9a0908f60418 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Created volume successfully. Sep 28 15:07:19 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 Sep 28 15:07:19 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:19 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-03bc40b9-15d3-4955-9884-6a2b2e820193 tempest-GroupsV320Test-752701707 None] Delete group completed successfully. Sep 28 15:07:19 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" returned: 0 in 0.495s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:19 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0 Sep 28 15:07:19 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:20 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-quobyte-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0" released by "delete_volume" :: held 1.134s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Created reservations ['dd2fda57-8af9-4b29-8212-61b8357af978', '4e92a4c2-2e41-4591-bb99-706af75ba366', '9d5ba506-a4da-476a-90af-9eb7afbc3d11', '30023ba2-b268-4c83-b2f9-4e15acd80862'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:20 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:20 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:20 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.507s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:20 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Deleted volume successfully. Sep 28 15:07:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5a0a057f-58d6-42ae-b197-831f7473cdf4 tempest-AttachVolumeNegativeTest-958876162 None] Lock "cinder-435c22cc-eb6d-41e6-bef8-8cd18e7da3b0-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe0065-94e2-4f87-9a83-161133aaab46]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:21 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 Sep 28 15:07:21 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:21 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3" returned: 0 in 0.560s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.595s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c7b0d8d-0e4b-44a1-9795-5b7b0f8e4ba8', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-4bed3e64-7323-4be5-83c6-6f7c0136af5c req-592c9b52-8c1c-49a0-9426-88150aeefc45 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] attachment_update completed successfully. Sep 28 15:07:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-eab7ca82-028a-45e3-9915-b00a68872496 req-2556bb77-5176-4c4c-ba07-bfbab393e4fb tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Terminate volume connection completed successfully. Sep 28 15:07:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-eab7ca82-028a-45e3-9915-b00a68872496 req-2556bb77-5176-4c4c-ba07-bfbab393e4fb tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Deleting attachment 9c7b0d8d-0e4b-44a1-9795-5b7b0f8e4ba8. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Acquiring lock "cinder-b7f64eda-34b6-47d8-85a9-c33b093e01a3-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "cinder-b7f64eda-34b6-47d8-85a9-c33b093e01a3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Acquiring lock "cinder-quobyte-b7f64eda-34b6-47d8-85a9-c33b093e01a3" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "cinder-quobyte-b7f64eda-34b6-47d8-85a9-c33b093e01a3" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da9906-361a-4dda-9921-05a260aaeb77]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:28 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 Sep 28 15:07:28 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:29 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3" returned: 0 in 0.596s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:29 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3 Sep 28 15:07:29 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:29 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b7f64eda-34b6-47d8-85a9-c33b093e01a3" returned: 0 in 0.357s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "cinder-quobyte-b7f64eda-34b6-47d8-85a9-c33b093e01a3" released by "delete_volume" :: held 1.052s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Created reservations ['a1856301-e515-4c97-afc0-4fbb7529d06f', '2d9a5aba-1f0d-4bdc-b5d0-77c520e051c5', 'c63704f3-16b8-496e-8fe4-faeecd6de563', 'c9e7329f-49e3-42d9-a810-992a13c4fe42'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:29 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:29 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:30 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.381s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:30 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Deleted volume successfully. Sep 28 15:07:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-294a5a27-e887-4929-a512-058508263af7 tempest-TestServerVolumeAttachScenarioOldVersion-1917504675 None] Lock "cinder-b7f64eda-34b6-47d8-85a9-c33b093e01a3-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Flow 'volume_create_manager' (b196c94a-0916-4508-a243-9957064da843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e290c-00f8-42cc-b351-9eed012e869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e290c-00f8-42cc-b351-9eed012e869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1101656615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e129a6-047d-4743-a74f-cd9b939b55f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604c7e7bd8084be996bc2803edd480a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:38Z,use_quota=True,user_id='33be2363b9c9433e9866551935ce9a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07674df-6b5d-40b8-a1f7-d26fb6fb792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07674df-6b5d-40b8-a1f7-d26fb6fb792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7b4c2e-3b4c-4302-8ef5-4b14077db21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7b4c2e-3b4c-4302-8ef5-4b14077db21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e129a6-047d-4743-a74f-cd9b939b55f9', 'volume_name': 'volume-f8e129a6-047d-4743-a74f-cd9b939b55f9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc65a0b-cb65-4002-ad62-d2150c02aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc65a0b-cb65-4002-ad62-d2150c02aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec11fdf0-2b33-46c0-b27c-b7cf2bce026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Volume f8e129a6-047d-4743-a74f-cd9b939b55f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e129a6-047d-4743-a74f-cd9b939b55f9', 'volume_size': 1} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1101656615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e129a6-047d-4743-a74f-cd9b939b55f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604c7e7bd8084be996bc2803edd480a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:38Z,use_quota=True,user_id='33be2363b9c9433e9866551935ce9a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Creating volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:07:37 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:07:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:38 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 1073741824 Sep 28 15:07:38 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:38 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 1073741824" returned: 0 in 0.636s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:38 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 Sep 28 15:07:38 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:38 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9" returned: 0 in 0.337s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=85,cinder:SELECT=71,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec11fdf0-2b33-46c0-b27c-b7cf2bce026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e129a6-047d-4743-a74f-cd9b939b55f9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9cb658-ee16-43e7-8812-ef2af9db2d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Volume volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 (f8e129a6-047d-4743-a74f-cd9b939b55f9): created successfully Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9cb658-ee16-43e7-8812-ef2af9db2d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Flow 'volume_create_manager' (b196c94a-0916-4508-a243-9957064da843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dad4e91e-4ec9-4946-b044-acd7361d8e63 tempest-SnapshotsActionsTest-85784154 None] Created volume successfully. Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Creating offline snapshot bd991ffb-63a8-45f6-a019-4c5466de409f of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8a3dd-9dba-4f85-a600-2f010486ab4e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:40 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 Sep 28 15:07:40 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:40 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:07:40 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:40 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9" returned: 0 in 0.592s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:40 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f 1G Sep 28 15:07:40 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:41 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.438s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:07:41 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f 1G" returned: 0 in 0.707s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:41 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:07:41 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f is being set with open permissions: ugo+rw Sep 28 15:07:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:07:42 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.348s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info Sep 28 15:07:42 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info is being set with open permissions: ugo+rw Sep 28 15:07:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info Sep 28 15:07:42 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:43 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.info" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7086c5b1-da38-48d0-b780-a43d82efd075 tempest-SnapshotsActionsTest-85784154 None] Create snapshot completed successfully Sep 28 15:07:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Creating offline snapshot f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef64a2c-224a-4df6-89df-8d2fe8991c70]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:07:45 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.565s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 1G Sep 28 15:07:45 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:46 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 1G" returned: 0 in 0.820s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:46 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 Sep 28 15:07:46 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:46 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" returned: 0 in 0.570s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 is being set with open permissions: ugo+rw Sep 28 15:07:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:46 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 Sep 28 15:07:46 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:47 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" returned: 0 in 0.540s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-21cf7951-246b-4c8a-bb35-efc51122bed1 tempest-SnapshotsActionsTest-85784154 None] Create snapshot completed successfully Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-f97ed2f4-40b2-4d85-8eaa-4752b41f4f20-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-f97ed2f4-40b2-4d85-8eaa-4752b41f4f20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Deleting offline snapshot f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] snapshot_file for this snap is: volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd6fb4-112e-4a4c-b197-703a5fdfebbf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd14a603-b42c-4812-b3f6-bb1b5b92fdda tempest-BackendsCapabilitiesAdminTestsJSON-284481669 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2040061950684, 'free_capacity_gb': 1775.2040061950684, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86888) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:07:48 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 Sep 28 15:07:48 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2dc36a9f-eff0-4d4f-89a3-b60b9784684c tempest-BackendsCapabilitiesAdminTestsJSON-284481669 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2040061950684, 'free_capacity_gb': 1775.2040061950684, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86888) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:07:48 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" returned: 0 in 0.561s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340b609-2a4d-484f-b854-963f313332b0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:07:48 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:49 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.556s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:49 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 Sep 28 15:07:49 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:49 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" returned: 0 in 0.583s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:50 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20 Sep 28 15:07:50 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:50 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" returned: 0 in 0.333s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f97ed2f4-40b2-4d85-8eaa-4752b41f4f20" released by "_delete_snapshot" :: held 2.218s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" released by "delete_snapshot" :: held 2.260s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:50 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Created reservations ['4d3114a5-4997-4a3f-a25b-70628ddba6b5', '32200864-e409-49de-aaaa-dd0f01696eae', '39323621-f076-4a3c-bbf1-90d8e00498b2', 'a646cd9c-4fc7-41ea-a43e-47dbb195c1fa'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:50 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Delete snapshot completed successfully. Sep 28 15:07:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-140bbb1e-20d8-4aeb-97f8-9cccf3686306 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-f97ed2f4-40b2-4d85-8eaa-4752b41f4f20-delete_snapshot" released by "delete_snapshot" :: held 2.475s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Creating offline snapshot 73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:51 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1bd928-a218-416e-9310-2eaf21bcf686]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:07:52 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.716s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 1G Sep 28 15:07:52 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 1G" returned: 0 in 1.165s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:53 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 Sep 28 15:07:53 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" returned: 0 in 0.676s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 is being set with open permissions: ugo+rw Sep 28 15:07:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 Sep 28 15:07:54 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" returned: 0 in 0.637s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.418s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e56f3857-c4ad-4d30-92bb-c340b724067c tempest-SnapshotsActionsTest-85784154 None] Create snapshot completed successfully Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Deleting offline snapshot 73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] snapshot_file for this snap is: volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d52348-a992-43db-b124-2802514ed3e3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 Sep 28 15:07:57 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" returned: 0 in 0.687s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b6db5f-beaa-4d31-bdba-d22cf2b2d64d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:07:57 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.813s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 Sep 28 15:07:58 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:59 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" returned: 0 in 0.925s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:59 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43 Sep 28 15:07:59 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:59 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" returned: 0 in 0.461s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43" released by "_delete_snapshot" :: held 3.138s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" released by "delete_snapshot" :: held 3.205s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:00 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Created reservations ['5697aadb-0154-4d9c-9653-457ff05fedd3', 'e3d79258-2a04-4e5f-be5a-6de71f5ae00c', '6a0256d5-f7ed-4824-a44b-460d9bbac206', '0d36161d-ca93-4a5f-9a93-b26cf0fa698e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Delete snapshot completed successfully. Sep 28 15:08:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb848540-2d14-412a-aaf1-a223a9d04d9d tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-73369b7a-9e7c-4e7d-aa48-f6a8d1e54e43-delete_snapshot" released by "delete_snapshot" :: held 3.534s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f968c895-f9fe-4edd-b0a8-6831422c8659 tempest-GroupsTest-1687038744 None] Group tempest-Group1-726514243: creating Sep 28 15:08:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f968c895-f9fe-4edd-b0a8-6831422c8659 tempest-GroupsTest-1687038744 None] Group tempest-Group1-726514243: created successfully Sep 28 15:08:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f968c895-f9fe-4edd-b0a8-6831422c8659 tempest-GroupsTest-1687038744 None] Create group completed successfully. Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Creating offline snapshot 432c1fcc-c311-4b1e-a36c-de98cb37d794 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f08528-c503-4a5a-8da3-68397564f721]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:02 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:02 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:02 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.604s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:02 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 1G Sep 28 15:08:02 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-71a56080-e960-4f2d-ac98-f3b73d439e05 tempest-GroupsTest-1687038744 None] Group tempest-Group2-321198111: creating Sep 28 15:08:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-71a56080-e960-4f2d-ac98-f3b73d439e05 tempest-GroupsTest-1687038744 None] Group tempest-Group2-321198111: created successfully Sep 28 15:08:03 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 1G" returned: 0 in 0.759s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-71a56080-e960-4f2d-ac98-f3b73d439e05 tempest-GroupsTest-1687038744 None] Create group completed successfully. Sep 28 15:08:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 Sep 28 15:08:03 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:04 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 is being set with open permissions: ugo+rw Sep 28 15:08:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:04 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 Sep 28 15:08:04 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:04 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794" returned: 0 in 0.302s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8e4e2a16-d374-42ea-a5fb-79bf180f6b33 tempest-SnapshotsActionsTest-85784154 None] Create snapshot completed successfully Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-432c1fcc-c311-4b1e-a36c-de98cb37d794-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-432c1fcc-c311-4b1e-a36c-de98cb37d794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Flow 'volume_create_manager' (4d5f726b-92a3-481b-85d7-cc2c9b409c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233bc83a-1a31-4e4f-900a-87890f343e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-432c1fcc-c311-4b1e-a36c-de98cb37d794" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233bc83a-1a31-4e4f-900a-87890f343e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-176306285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4a634b0-94c6-48b2-92cd-f028ea4c7f5f,host='devstack@QuobyteHD#QuobyteHD',id=451bdbf7-70f0-4a19-9c17-ba7ddb4721f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa766b9e45a24d309d725ca608f856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:06Z,use_quota=True,user_id='477423b7f67345ae920f57d932109628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c8a6eea-1101-418f-b026-7a01d99a8223),volume_type_id=5c8a6eea-1101-418f-b026-7a01d99a8223)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d1f13e-c789-4e32-a58f-468f045e4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d1f13e-c789-4e32-a58f-468f045e4689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445f3306-217d-48c8-8fa2-4315d430dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445f3306-217d-48c8-8fa2-4315d430dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451bdbf7-70f0-4a19-9c17-ba7ddb4721f9', 'volume_name': 'volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d684d6-8254-4904-aa6a-8bc99d7fada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d684d6-8254-4904-aa6a-8bc99d7fada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56521ad-9f45-4f17-9f54-fb12c4394b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:05 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Volume 451bdbf7-70f0-4a19-9c17-ba7ddb4721f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9', 'volume_size': 1} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4a634b0-94c6-48b2-92cd-f028ea4c7f5f,created_at=2026-09-28T13:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-176306285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4a634b0-94c6-48b2-92cd-f028ea4c7f5f,host='devstack@QuobyteHD#QuobyteHD',id=451bdbf7-70f0-4a19-9c17-ba7ddb4721f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa766b9e45a24d309d725ca608f856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:06Z,use_quota=True,user_id='477423b7f67345ae920f57d932109628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c8a6eea-1101-418f-b026-7a01d99a8223),volume_type_id=5c8a6eea-1101-418f-b026-7a01d99a8223)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Creating volume 451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:08:05 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-432c1fcc-c311-4b1e-a36c-de98cb37d794" acquired by "_delete_snapshot" :: waited 0.126s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Deleting offline snapshot 432c1fcc-c311-4b1e-a36c-de98cb37d794 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:05 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 1073741824 Sep 28 15:08:05 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] snapshot_file for this snap is: volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ef0e5-859d-414b-92dc-ede36b800d1a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:06 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 Sep 28 15:08:06 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:06 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 1073741824" returned: 0 in 0.664s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:06 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794" returned: 0 in 0.600s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[670fddc9-cd56-4436-b07e-b61801a38836]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:06 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 Sep 28 15:08:06 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:06 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:06 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:07 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9" returned: 0 in 0.493s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:07 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56521ad-9f45-4f17-9f54-fb12c4394b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1795de4-92e6-4a09-8149-8c0bbc345ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.607s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:07 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Volume volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 (451bdbf7-70f0-4a19-9c17-ba7ddb4721f9): created successfully Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1795de4-92e6-4a09-8149-8c0bbc345ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Flow 'volume_create_manager' (4d5f726b-92a3-481b-85d7-cc2c9b409c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:07 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 Sep 28 15:08:07 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6ccced73-6136-4bd9-8983-59be29c547ab tempest-GroupsTest-1687038744 None] Created volume successfully. Sep 28 15:08:07 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794" returned: 0 in 0.616s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:07 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794 Sep 28 15:08:07 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:08 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.432c1fcc-c311-4b1e-a36c-de98cb37d794" returned: 0 in 0.318s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-432c1fcc-c311-4b1e-a36c-de98cb37d794" released by "_delete_snapshot" :: held 2.343s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" released by "delete_snapshot" :: held 2.481s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:08 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Created reservations ['08c9219c-98c6-4ba4-aefa-e9daf002eaec', 'ff5b85dd-a470-4e3d-8a08-baeaa53735f7', '230e5427-1932-4191-9868-160484e7096d', '3798870b-e73d-4fb0-86db-6640f0563ce0'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Delete snapshot completed successfully. Sep 28 15:08:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-821f9f54-be6a-4377-89ef-bf497e3e32c4 tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-432c1fcc-c311-4b1e-a36c-de98cb37d794-delete_snapshot" released by "delete_snapshot" :: held 2.860s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Acquiring lock "cinder-quobyte-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Lock "cinder-quobyte-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c991c7-6f99-4fec-94c4-7db67b1b4213]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 Sep 28 15:08:09 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Creating offline snapshot 091c8487-5cdd-4850-a1a7-6821baecd253 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d7ab3-56d5-44d4-9e1c-2a6aec4a9fda]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9" returned: 0 in 0.739s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:09 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:09 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9 Sep 28 15:08:09 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Lock "cinder-quobyte-451bdbf7-70f0-4a19-9c17-ba7ddb4721f9" released by "delete_volume" :: held 1.199s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:10 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.573s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 1G Sep 28 15:08:10 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Created reservations ['6c94fd4a-a431-4d0b-ac93-44722e546d4c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:10 devstack cinder-volume[86888]: WARNING cinder.quota [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1227523692 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1227523692, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:10 devstack cinder-volume[86888]: WARNING cinder.quota [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1227523692 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1227523692, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Created reservations ['815edcee-5b10-432a-8017-8c18b5998e60', '9229a7c2-99f6-4fb0-ba08-ffe7a913ddb6', '53da4e69-3928-4fbd-84c4-a264b350bf41', '4bddd5dc-c7da-488d-970e-ae627ec6e7a7'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:08:10 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:11 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.504s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c50f3782-33eb-4cc2-9211-a9f5da3cd064 tempest-GroupsTest-1687038744 None] Delete group completed successfully. Sep 28 15:08:11 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 1G" returned: 0 in 1.068s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:11 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 Sep 28 15:08:11 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:11 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253" returned: 0 in 0.473s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:11 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 is being set with open permissions: ugo+rw Sep 28 15:08:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:11 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 Sep 28 15:08:11 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Created reservations ['88fef0b3-6b6d-412a-bb11-b66d1396f582'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:12 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:08:12 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:12 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.733s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4c8435bb-664f-42d0-8100-c1df54c97fc6 tempest-SnapshotsActionsTest-85784154 None] Create snapshot completed successfully Sep 28 15:08:12 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:12 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9170fa33-1582-45f6-b4bb-5062c5186258 tempest-GroupsTest-1687038744 None] Delete group completed successfully. Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-091c8487-5cdd-4850-a1a7-6821baecd253-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-091c8487-5cdd-4850-a1a7-6821baecd253-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Acquiring lock "cinder-quobyte-091c8487-5cdd-4850-a1a7-6821baecd253" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-091c8487-5cdd-4850-a1a7-6821baecd253" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Deleting offline snapshot 091c8487-5cdd-4850-a1a7-6821baecd253 of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] snapshot_file for this snap is: volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0573161-3d14-4a4e-ae77-e38c8a11faaa]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 Sep 28 15:08:13 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:13 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253" returned: 0 in 0.578s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6251a32-31f1-4706-81ac-49a1ad960dd2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:13 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:13 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:14 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=84,cinder:INSERT=23,cinder:UPDATE=78,cinder:DELETE=5 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-30fe0ba9-4c60-483e-917c-661623036e43 tempest-GroupsTest-1687038744 None] Group tempest-GroupsTest-Group-205286918: creating Sep 28 15:08:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-30fe0ba9-4c60-483e-917c-661623036e43 tempest-GroupsTest-1687038744 None] Group tempest-GroupsTest-Group-205286918: created successfully Sep 28 15:08:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-30fe0ba9-4c60-483e-917c-661623036e43 tempest-GroupsTest-1687038744 None] Create group completed successfully. Sep 28 15:08:14 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.468s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:14 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 Sep 28 15:08:14 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:14 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253" returned: 0 in 0.518s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:14 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253 Sep 28 15:08:14 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:15 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.091c8487-5cdd-4850-a1a7-6821baecd253" returned: 0 in 0.291s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-091c8487-5cdd-4850-a1a7-6821baecd253" released by "_delete_snapshot" :: held 2.016s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" released by "delete_snapshot" :: held 2.051s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Created reservations ['a70ed77c-d356-47b8-977b-d752d0d903b5', 'dfdfbaef-dc49-41d2-ba52-aaef70899264', 'b13a9f8b-b27c-47d7-8212-abfc4f9d3348', '5e91d71b-61a7-43af-9a68-634c8889027b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:15 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Delete snapshot completed successfully. Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1c85b1dc-2072-446a-a24c-b6c60c5fae4e tempest-SnapshotsActionsTest-1504587949 None] Lock "cinder-091c8487-5cdd-4850-a1a7-6821baecd253-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Flow 'volume_create_manager' (c87160c7-bc8e-4f88-9ce4-4281be43f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4793413d-6700-474d-b851-f33aa9323518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4793413d-6700-474d-b851-f33aa9323518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988995781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35894f1d-9714-4dcf-b476-d558b810203e,host='devstack@QuobyteHD#QuobyteHD',id=08f6f693-fd6b-4d89-ba2a-f580948890fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa766b9e45a24d309d725ca608f856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:16Z,use_quota=True,user_id='477423b7f67345ae920f57d932109628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50364ea0-450c-4b97-b15c-455b5097e43a),volume_type_id=50364ea0-450c-4b97-b15c-455b5097e43a)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d156fbc5-60fb-44e6-b3ed-99c493da381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d156fbc5-60fb-44e6-b3ed-99c493da381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7282e46-6aae-4bd1-97bc-638f207659c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7282e46-6aae-4bd1-97bc-638f207659c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f6f693-fd6b-4d89-ba2a-f580948890fe', 'volume_name': 'volume-08f6f693-fd6b-4d89-ba2a-f580948890fe', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3116ce1a-a2f1-4c3f-bce6-04fbeec705bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3116ce1a-a2f1-4c3f-bce6-04fbeec705bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e36c1d5-9faf-40bc-8cbd-ac9a2ae41d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:15 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Volume 08f6f693-fd6b-4d89-ba2a-f580948890fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f6f693-fd6b-4d89-ba2a-f580948890fe', 'volume_size': 1} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35894f1d-9714-4dcf-b476-d558b810203e,created_at=2026-09-28T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988995781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35894f1d-9714-4dcf-b476-d558b810203e,host='devstack@QuobyteHD#QuobyteHD',id=08f6f693-fd6b-4d89-ba2a-f580948890fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa766b9e45a24d309d725ca608f856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:16Z,use_quota=True,user_id='477423b7f67345ae920f57d932109628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50364ea0-450c-4b97-b15c-455b5097e43a),volume_type_id=50364ea0-450c-4b97-b15c-455b5097e43a)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Creating volume 08f6f693-fd6b-4d89-ba2a-f580948890fe {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:08:15 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:08:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:15 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe 1073741824 Sep 28 15:08:15 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:16 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe 1073741824" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:16 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe Sep 28 15:08:16 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "cinder-bd991ffb-63a8-45f6-a019-4c5466de409f-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-bd991ffb-63a8-45f6-a019-4c5466de409f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "cinder-quobyte-bd991ffb-63a8-45f6-a019-4c5466de409f" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-quobyte-bd991ffb-63a8-45f6-a019-4c5466de409f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Deleting offline snapshot bd991ffb-63a8-45f6-a019-4c5466de409f of volume f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] snapshot_file for this snap is: volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7ff65-b0b4-4856-a62c-9953e42cd75a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:17 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe" returned: 0 in 0.485s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e36c1d5-9faf-40bc-8cbd-ac9a2ae41d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f6f693-fd6b-4d89-ba2a-f580948890fe', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cad210b-e093-442c-a77f-3e93172625a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:17 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Volume volume-08f6f693-fd6b-4d89-ba2a-f580948890fe (08f6f693-fd6b-4d89-ba2a-f580948890fe): created successfully Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cad210b-e093-442c-a77f-3e93172625a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Flow 'volume_create_manager' (c87160c7-bc8e-4f88-9ce4-4281be43f13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:17 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:17 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fcac7fa8-41fc-496b-88e8-4abe1f0ce634 tempest-GroupsTest-1687038744 None] Created volume successfully. Sep 28 15:08:17 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.600s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e129a6-047d-4743-a74f-cd9b939b55f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83ad7d-fb91-4f22-ac0e-fb23071b1927]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:17 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 Sep 28 15:08:17 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:18 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9" returned: 0 in 0.474s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:18 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:18 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:18 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.569s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:18 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f Sep 28 15:08:18 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Flow 'volume_create_manager' (da4f40ca-bee0-4444-9093-89e02656bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effae9ce-fa3c-485f-826c-90a866545f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effae9ce-fa3c-485f-826c-90a866545f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778265405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35894f1d-9714-4dcf-b476-d558b810203e,host='devstack@QuobyteHD#QuobyteHD',id=0d7afbbe-ac8a-4407-832a-cda6ee6519a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa766b9e45a24d309d725ca608f856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:19Z,use_quota=True,user_id='477423b7f67345ae920f57d932109628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50364ea0-450c-4b97-b15c-455b5097e43a),volume_type_id=50364ea0-450c-4b97-b15c-455b5097e43a)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e738b8-25af-443c-a7d4-5058085598bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e738b8-25af-443c-a7d4-5058085598bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a2aa98-aaf1-4552-b4e1-e36556c86118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a2aa98-aaf1-4552-b4e1-e36556c86118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7afbbe-ac8a-4407-832a-cda6ee6519a4', 'volume_name': 'volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2258bee9-6607-4999-b001-8351103d0095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2258bee9-6607-4999-b001-8351103d0095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe007107-bb46-4ff7-8b15-6ea60b5560b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:19 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Volume 0d7afbbe-ac8a-4407-832a-cda6ee6519a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4', 'volume_size': 1} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35894f1d-9714-4dcf-b476-d558b810203e,created_at=2026-09-28T13:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778265405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35894f1d-9714-4dcf-b476-d558b810203e,host='devstack@QuobyteHD#QuobyteHD',id=0d7afbbe-ac8a-4407-832a-cda6ee6519a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa766b9e45a24d309d725ca608f856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:19Z,use_quota=True,user_id='477423b7f67345ae920f57d932109628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50364ea0-450c-4b97-b15c-455b5097e43a),volume_type_id=50364ea0-450c-4b97-b15c-455b5097e43a)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Creating volume 0d7afbbe-ac8a-4407-832a-cda6ee6519a4 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:08:19 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:19 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 1073741824 Sep 28 15:08:19 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:19 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9.bd991ffb-63a8-45f6-a019-4c5466de409f" returned: 0 in 0.715s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-quobyte-bd991ffb-63a8-45f6-a019-4c5466de409f" released by "_delete_snapshot" :: held 2.574s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" released by "delete_snapshot" :: held 2.618s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Created reservations ['bb3398e9-1357-42f0-82ca-bc1e0c98e621', '9669fefd-96ae-4d7a-8c08-b75883928a10', '6b36ef62-f610-4b43-b118-13c3fa14f6a4', '18edf134-f0f1-4c29-8210-07da03950687'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Delete snapshot completed successfully. Sep 28 15:08:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d3fb86c-beec-416f-8140-6ff556590463 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-bd991ffb-63a8-45f6-a019-4c5466de409f-delete_snapshot" released by "delete_snapshot" :: held 2.841s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:20 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 1073741824" returned: 0 in 0.659s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:20 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 Sep 28 15:08:20 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "cinder-f8e129a6-047d-4743-a74f-cd9b939b55f9-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-f8e129a6-047d-4743-a74f-cd9b939b55f9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91e0df-e56e-42b2-8bbc-27cbefd84323]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:20 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4" returned: 0 in 0.551s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe007107-bb46-4ff7-8b15-6ea60b5560b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01022784-f5dc-42e5-a48c-795762992d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:20 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Volume volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 (0d7afbbe-ac8a-4407-832a-cda6ee6519a4): created successfully Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01022784-f5dc-42e5-a48c-795762992d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Flow 'volume_create_manager' (da4f40ca-bee0-4444-9093-89e02656bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:20 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-684af1e3-5919-4329-8e13-b09ae78f6531 tempest-GroupsTest-1687038744 None] Created volume successfully. Sep 28 15:08:20 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 Sep 28 15:08:20 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:21 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9" returned: 0 in 0.502s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:21 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9 Sep 28 15:08:21 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:21 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8e129a6-047d-4743-a74f-cd9b939b55f9" returned: 0 in 0.357s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-quobyte-f8e129a6-047d-4743-a74f-cd9b939b55f9" released by "delete_volume" :: held 0.961s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Created reservations ['e2f9eaf1-0b1f-46e9-ae6b-eccd593c22ac', '218b1960-bc4b-4a18-9b98-3d11ef8f9174', '526f3f26-74f0-467f-a6b6-0876be0a7dc0', '3d173cc2-53c6-4a1d-bb90-61f16abd25d9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:21 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:08:21 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Flow 'volume_create_manager' (c6ffe6bc-d4b2-40f0-af57-95dc6a3efda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe1c33a-5d12-4c72-a818-dcfe24d84ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe1c33a-5d12-4c72-a818-dcfe24d84ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-745251505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a9857-cdf3-4207-85fc-6116a6ce2c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782749754f094414b7471c08a96c3b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:22Z,use_quota=True,user_id='42262b7c4b9c4fd48e2888159148706a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b6d711-0b04-4247-aec5-b2855b323a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b6d711-0b04-4247-aec5-b2855b323a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468c4a1f-8f04-4511-b1df-df9fa69ef51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468c4a1f-8f04-4511-b1df-df9fa69ef51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336a9857-cdf3-4207-85fc-6116a6ce2c6a', 'volume_name': 'volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c704f8a-836b-4935-b12d-6500796807cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c704f8a-836b-4935-b12d-6500796807cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60092a5f-792b-47b3-8ac9-0857c68fa155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:22 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Volume 336a9857-cdf3-4207-85fc-6116a6ce2c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a', 'volume_size': 1} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-745251505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a9857-cdf3-4207-85fc-6116a6ce2c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782749754f094414b7471c08a96c3b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:22Z,use_quota=True,user_id='42262b7c4b9c4fd48e2888159148706a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Creating volume 336a9857-cdf3-4207-85fc-6116a6ce2c6a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:08:22 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:22 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:22 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a 1073741824 Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:22 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Deleted volume successfully. Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-87c130ba-0565-4d54-8ba1-8cc264f01257 tempest-SnapshotsActionsTest-85784154 None] Lock "cinder-f8e129a6-047d-4743-a74f-cd9b939b55f9-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bf7fe301-9a99-4c66-86f7-edee44712018 tempest-GroupsTest-1687038744 None] Update group completed successfully. Sep 28 15:08:22 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a 1073741824" returned: 0 in 0.577s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:22 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a Sep 28 15:08:22 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:23 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a" returned: 0 in 0.355s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60092a5f-792b-47b3-8ac9-0857c68fa155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e40075-fe63-4ea5-be5f-33daf6293e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Volume volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a (336a9857-cdf3-4207-85fc-6116a6ce2c6a): created successfully Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e40075-fe63-4ea5-be5f-33daf6293e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Flow 'volume_create_manager' (c6ffe6bc-d4b2-40f0-af57-95dc6a3efda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a54260af-2daf-4909-980b-3ad98fb79ee0 tempest-AttachVolumeTestJSON-915533788 None] Created volume successfully. Sep 28 15:08:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9766ce9f-3a6e-4429-a963-2dc17d61d5a0 tempest-GroupsTest-1687038744 None] Update group completed successfully. Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a397e5e9-9b90-470a-8d88-ce0dafa4acc8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:25 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a Sep 28 15:08:25 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Acquiring lock "cinder-quobyte-08f6f693-fd6b-4d89-ba2a-f580948890fe" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Lock "cinder-quobyte-08f6f693-fd6b-4d89-ba2a-f580948890fe" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:25 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a" returned: 0 in 0.627s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.659s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ddc1e4-0c69-4466-b698-227a8a683c91]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d9b503d-af19-43e8-bd51-fc0de63103d1', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:08:25 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-cc9dad78-6bdb-4656-a80e-f7c560ee64ed req-6ce9916d-917c-4474-aad5-0051f6c41530 tempest-AttachVolumeTestJSON-915533788 None] attachment_update completed successfully. Sep 28 15:08:26 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe Sep 28 15:08:26 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:26 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe" returned: 0 in 0.652s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:26 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe Sep 28 15:08:26 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:26 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08f6f693-fd6b-4d89-ba2a-f580948890fe" returned: 0 in 0.378s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Lock "cinder-quobyte-08f6f693-fd6b-4d89-ba2a-f580948890fe" released by "delete_volume" :: held 1.124s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Acquiring lock "cinder-quobyte-0d7afbbe-ac8a-4407-832a-cda6ee6519a4" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Lock "cinder-quobyte-0d7afbbe-ac8a-4407-832a-cda6ee6519a4" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e613e7c4-bc50-4c1c-a328-c4f961563137]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 Sep 28 15:08:27 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:27 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4" returned: 0 in 0.708s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4 Sep 28 15:08:27 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0d7afbbe-ac8a-4407-832a-cda6ee6519a4" returned: 0 in 0.381s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Lock "cinder-quobyte-0d7afbbe-ac8a-4407-832a-cda6ee6519a4" released by "delete_volume" :: held 1.164s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Created reservations ['0e159089-e993-4bc8-9f54-81a87d861ba2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:28 devstack cinder-volume[86888]: WARNING cinder.quota [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-226943232 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-226943232, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:28 devstack cinder-volume[86888]: WARNING cinder.quota [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-226943232 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-226943232, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Created reservations ['7a1731c9-7503-402a-9547-9867356589ed', 'e8370f95-8788-4445-bdf6-18c6cb5e35ed', '9e581c4f-1e7b-402b-9130-1d91523ff1f9', '3ca9a1d9-381c-4ddf-8665-89ced10b83f4'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Created reservations ['3638bbea-2c98-490f-a4c1-796d906dc5db', 'c57aae22-18ef-4d9c-b2f2-bb502656c233', 'bf93c5a0-e2ed-40f1-942d-5fae0d1b2401', '696bcb8c-e78e-42fc-8958-957574b790aa'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:28 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:08:28 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:29 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.456s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:29 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-72d38459-52d7-49f5-a439-43fae4ebc636 tempest-GroupsTest-1687038744 None] Delete group completed successfully. Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Flow 'volume_create_manager' (1ae9b20a-075e-4d76-be17-6d544b8d46c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820bfb7d-0635-4331-ac81-e1e189f4a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820bfb7d-0635-4331-ac81-e1e189f4a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1624756752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40375d0-64bf-4726-bdd0-74fd287023d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7723c2e4914fff80a809d5c3c5d833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='44e20ae31d9e43ae867143adee5a4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3485b30-efbd-4332-845a-15ef5b8f03aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3485b30-efbd-4332-845a-15ef5b8f03aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59acf3c9-112b-4d86-8148-d6b0f2917934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59acf3c9-112b-4d86-8148-d6b0f2917934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a40375d0-64bf-4726-bdd0-74fd287023d9', 'volume_name': 'volume-a40375d0-64bf-4726-bdd0-74fd287023d9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20db2a3b-b59c-4442-9541-1c3c0ef677a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20db2a3b-b59c-4442-9541-1c3c0ef677a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72de9fe4-0f2f-4580-8c94-3589a96ca998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Volume a40375d0-64bf-4726-bdd0-74fd287023d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a40375d0-64bf-4726-bdd0-74fd287023d9', 'volume_size': 1} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1624756752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40375d0-64bf-4726-bdd0-74fd287023d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7723c2e4914fff80a809d5c3c5d833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='44e20ae31d9e43ae867143adee5a4ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Creating volume a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:08:34 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:08:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:34 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 1073741824 Sep 28 15:08:34 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 1073741824" returned: 0 in 0.876s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 Sep 28 15:08:35 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9" returned: 0 in 0.454s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72de9fe4-0f2f-4580-8c94-3589a96ca998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40375d0-64bf-4726-bdd0-74fd287023d9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7467434-595e-407f-a105-e9df8e362734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:36 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Volume volume-a40375d0-64bf-4726-bdd0-74fd287023d9 (a40375d0-64bf-4726-bdd0-74fd287023d9): created successfully Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7467434-595e-407f-a105-e9df8e362734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Flow 'volume_create_manager' (1ae9b20a-075e-4d76-be17-6d544b8d46c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:36 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-298a8deb-e9b2-4d98-adfb-055a99a1ffab tempest-TestImageHashVerification-1041828824 None] Created volume successfully. Sep 28 15:08:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbf595-1b92-4a4f-9a28-42d78dc63273]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 Sep 28 15:08:39 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9" returned: 0 in 0.738s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63c522-68aa-4298-a9f9-2d2673d491f3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:40 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 Sep 28 15:08:40 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:40 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:08:40 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9" returned: 0 in 0.628s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 /opt/stack/data/cinder/conversion/a40375d0-64bf-4726-bdd0-74fd287023d9.temp_image.36dc835d-5d96-4b3a-a627-62d6d397011bar6ctnw5.img {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:40 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 /opt/stack/data/cinder/conversion/a40375d0-64bf-4726-bdd0-74fd287023d9.temp_image.36dc835d-5d96-4b3a-a627-62d6d397011bar6ctnw5.img Sep 28 15:08:40 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:41 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.463s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:08:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:08:46 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=85,cinder:UPDATE=92,cinder:DELETE=5,cinder:INSERT=23 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:49 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=56,cinder:SELECT=54,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:49 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Flow 'volume_create_manager' (031cd6bc-7474-4a43-be73-40fdaf340576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490aa651-3802-4ec3-9979-4d23b7fb0ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490aa651-3802-4ec3-9979-4d23b7fb0ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1075562122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3334cbdb-958a-4a40-8eb2-92940502889e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432b91a3ee3d4e33a5e36a131009e805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:50Z,use_quota=True,user_id='68a13491cad34f5ca893c6728a650ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b2630ad-5549-4f96-a35d-b41fdae32a8a),volume_type_id=2b2630ad-5549-4f96-a35d-b41fdae32a8a)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1181dc1-4517-488d-a3ec-faffe40ce656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1181dc1-4517-488d-a3ec-faffe40ce656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151e4858-a2ee-410f-bb3f-b1ed1179c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151e4858-a2ee-410f-bb3f-b1ed1179c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3334cbdb-958a-4a40-8eb2-92940502889e', 'volume_name': 'volume-3334cbdb-958a-4a40-8eb2-92940502889e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a25500-e164-4aa0-a9f2-92ede604562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a25500-e164-4aa0-a9f2-92ede604562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4afeada-18e3-42a3-8107-8d71dac133cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:50 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Volume 3334cbdb-958a-4a40-8eb2-92940502889e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3334cbdb-958a-4a40-8eb2-92940502889e', 'volume_size': 1} Sep 28 15:08:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:52 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 /opt/stack/data/cinder/conversion/a40375d0-64bf-4726-bdd0-74fd287023d9.temp_image.36dc835d-5d96-4b3a-a627-62d6d397011bar6ctnw5.img" returned: 0 in 11.513s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[da312405-cc09-4c64-a8ba-b91d0ffb1b20]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 Sep 28 15:08:52 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9" returned: 0 in 0.680s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9, size 1024.00 MB, duration 11.51 sec, destination /opt/stack/data/cinder/conversion/a40375d0-64bf-4726-bdd0-74fd287023d9.temp_image.36dc835d-5d96-4b3a-a627-62d6d397011bar6ctnw5.img {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:08:52 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Converted 1024.00 MB image at 88.94 MB/s Sep 28 15:08:52 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] 36dc835d-5d96-4b3a-a627-62d6d397011b was raw, no need to convert to raw {{(pid=86888) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 28 15:09:02 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:02 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Flow 'volume_create_manager' (521966da-ef4a-4498-ba86-643cba4f4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a416423-f1b9-4b01-a46c-0d771125d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a416423-f1b9-4b01-a46c-0d771125d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1764435445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c8a26d-4bec-4df3-81db-e042a5f36a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f799a817b744ad7812eb6fa52226cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:05Z,use_quota=True,user_id='1ee5bbdee4b5489ca1bfda1bc4c65af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1c41fd-73d1-49bb-8c15-a35068b9208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1c41fd-73d1-49bb-8c15-a35068b9208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188f040a-103a-4224-ad13-0b1a14cf10b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188f040a-103a-4224-ad13-0b1a14cf10b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c8a26d-4bec-4df3-81db-e042a5f36a21', 'volume_name': 'volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412eee56-2a51-46f8-86bc-2487b4e1ede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412eee56-2a51-46f8-86bc-2487b4e1ede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66624d37-c5d0-4651-a21a-13e9320b4b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:04 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Volume d2c8a26d-4bec-4df3-81db-e042a5f36a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21', 'volume_size': 1} Sep 28 15:09:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:14 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:14 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.263s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Uploaded volume to glance image-id: 36dc835d-5d96-4b3a-a627-62d6d397011b. {{(pid=86888) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.374s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1075562122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3334cbdb-958a-4a40-8eb2-92940502889e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432b91a3ee3d4e33a5e36a131009e805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:50Z,use_quota=True,user_id='68a13491cad34f5ca893c6728a650ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b2630ad-5549-4f96-a35d-b41fdae32a8a),volume_type_id=2b2630ad-5549-4f96-a35d-b41fdae32a8a)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Creating volume 3334cbdb-958a-4a40-8eb2-92940502889e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:09:16 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:09:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:16 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e 1073741824 Sep 28 15:09:16 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e9679eab-c8b5-4bf4-ac1e-83c38441c4f3 tempest-TestImageHashVerification-1041828824 None] Copy volume to image completed successfully. Sep 28 15:09:17 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e 1073741824" returned: 0 in 0.521s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e Sep 28 15:09:17 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e" returned: 0 in 0.262s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.600s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1764435445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c8a26d-4bec-4df3-81db-e042a5f36a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f799a817b744ad7812eb6fa52226cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:05Z,use_quota=True,user_id='1ee5bbdee4b5489ca1bfda1bc4c65af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Creating volume d2c8a26d-4bec-4df3-81db-e042a5f36a21 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:09:17 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4afeada-18e3-42a3-8107-8d71dac133cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3334cbdb-958a-4a40-8eb2-92940502889e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab044451-482b-4e9e-9eb9-b26fb4c4f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 1073741824 Sep 28 15:09:17 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Volume volume-3334cbdb-958a-4a40-8eb2-92940502889e (3334cbdb-958a-4a40-8eb2-92940502889e): created successfully Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab044451-482b-4e9e-9eb9-b26fb4c4f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Flow 'volume_create_manager' (031cd6bc-7474-4a43-be73-40fdaf340576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1525e2e3-ce14-4fdb-9eb9-6296696a4689 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Created volume successfully. Sep 28 15:09:18 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 1073741824" returned: 0 in 0.629s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 Sep 28 15:09:18 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Acquiring lock "cinder-a40375d0-64bf-4726-bdd0-74fd287023d9-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Lock "cinder-a40375d0-64bf-4726-bdd0-74fd287023d9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Acquiring lock "cinder-quobyte-a40375d0-64bf-4726-bdd0-74fd287023d9" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Lock "cinder-quobyte-a40375d0-64bf-4726-bdd0-74fd287023d9" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c708ef-82f3-496d-be80-58c80e9094b8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:18 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 Sep 28 15:09:18 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66624d37-c5d0-4651-a21a-13e9320b4b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d150281e-6398-4846-bc6f-47d4268bd7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:18 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Volume volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 (d2c8a26d-4bec-4df3-81db-e042a5f36a21): created successfully Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d150281e-6398-4846-bc6f-47d4268bd7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Flow 'volume_create_manager' (521966da-ef4a-4498-ba86-643cba4f4477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:18 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4abdfc73-aa66-4c00-8bcd-24e3f16a1e06 tempest-VolumesServicesTestJSON-1804101094 None] Created volume successfully. Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:09:18 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Acquiring lock "cinder-d2c8a26d-4bec-4df3-81db-e042a5f36a21-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9" returned: 0 in 0.661s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Lock "cinder-d2c8a26d-4bec-4df3-81db-e042a5f36a21-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9 Sep 28 15:09:19 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Acquiring lock "cinder-quobyte-d2c8a26d-4bec-4df3-81db-e042a5f36a21" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Lock "cinder-quobyte-d2c8a26d-4bec-4df3-81db-e042a5f36a21" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b21739-d829-41bb-9516-7dec3720be5b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.329s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f99061a4-1d08-47b7-a0f6-bd3447d3a631 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Retype volume completed successfully. Sep 28 15:09:19 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 Sep 28 15:09:19 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a40375d0-64bf-4726-bdd0-74fd287023d9" returned: 0 in 0.360s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Lock "cinder-quobyte-a40375d0-64bf-4726-bdd0-74fd287023d9" released by "delete_volume" :: held 1.093s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Created reservations ['899a2511-3591-416e-b25a-4e14b39a4518', '205c4d8d-f040-472e-99c9-62059e7acc79', 'a9764e4b-93de-461a-9584-337d527f3d05', 'defb84fe-0307-4ecb-83ac-102df86343af'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:09:19 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21" returned: 0 in 0.480s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21 Sep 28 15:09:19 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.294s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Deleted volume successfully. Sep 28 15:09:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9eebdc0e-62b1-4353-8ade-137756152626 tempest-TestImageHashVerification-1041828824 None] Lock "cinder-a40375d0-64bf-4726-bdd0-74fd287023d9-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2c8a26d-4bec-4df3-81db-e042a5f36a21" returned: 0 in 0.384s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Lock "cinder-quobyte-d2c8a26d-4bec-4df3-81db-e042a5f36a21" released by "delete_volume" :: held 0.930s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Created reservations ['6a958c9f-9a89-4801-a24e-6f6e742f43be', 'af50d8c6-b0c9-4bad-87dd-62050fa374e4', '7d32c9b3-d0d3-4b97-b4c1-33fb53e2f0d1', '6705ba9a-99b0-46c9-a2fa-e9cf666d02d4'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:09:20 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Acquiring lock "cinder-3334cbdb-958a-4a40-8eb2-92940502889e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "cinder-3334cbdb-958a-4a40-8eb2-92940502889e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Acquiring lock "cinder-quobyte-3334cbdb-958a-4a40-8eb2-92940502889e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "cinder-quobyte-3334cbdb-958a-4a40-8eb2-92940502889e" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3e265-44f8-49ff-bd9d-5ba4ae34ff21]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.483s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:20 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Deleted volume successfully. Sep 28 15:09:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-71cce37d-1fe9-4594-8655-2249c11d7368 tempest-VolumesServicesTestJSON-1804101094 None] Lock "cinder-d2c8a26d-4bec-4df3-81db-e042a5f36a21-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e Sep 28 15:09:20 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e" returned: 0 in 0.717s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:21 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e Sep 28 15:09:21 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-819d432f-4750-4425-928f-9f0ca641a38f req-f42ffdbf-27d4-4918-be5d-337dab2149de tempest-AttachVolumeTestJSON-915533788 None] Terminate volume connection completed successfully. Sep 28 15:09:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-819d432f-4750-4425-928f-9f0ca641a38f req-f42ffdbf-27d4-4918-be5d-337dab2149de tempest-AttachVolumeTestJSON-915533788 None] Deleting attachment 8d9b503d-af19-43e8-bd51-fc0de63103d1. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:09:21 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3334cbdb-958a-4a40-8eb2-92940502889e" returned: 0 in 0.473s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "cinder-quobyte-3334cbdb-958a-4a40-8eb2-92940502889e" released by "delete_volume" :: held 1.305s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:21 devstack cinder-volume[86888]: WARNING cinder.quota [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:21 devstack cinder-volume[86888]: WARNING cinder.quota [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:09:21 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Created reservations ['cf67dec1-fa24-4f0c-8fc3-4f2269dc9a6b', '5b7ccfa2-e6e7-4676-b947-1d5334cc083b', 'b6600afa-9cf4-47e4-b912-0b72d83f8d83', 'd0c492a8-c7ae-4213-8ea1-2b61e90e682c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:22 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:09:22 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:22 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.605s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Deleted volume successfully. Sep 28 15:09:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-af697ceb-9644-4cac-ab62-f425fdb9a775 tempest-VolumeRetypeWithoutMigrationTest-1252350846 None] Lock "cinder-3334cbdb-958a-4a40-8eb2-92940502889e-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:32 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=36,cinder:DELETE=2,cinder:SELECT=26,cinder:INSERT=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:32 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=25,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Flow 'volume_create_manager' (b8c40014-133e-498f-9cb8-5b6eee1d9734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e0c6da-e45f-4baa-b853-12dcc309d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e0c6da-e45f-4baa-b853-12dcc309d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1003112296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add929d0070240e694ffaa1866f9e8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:35Z,use_quota=True,user_id='3d96fbec59c44a339d5e71be09d74a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5861388d-0457-46bb-8832-7aac281b84cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5861388d-0457-46bb-8832-7aac281b84cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3efddd-5bc8-43b4-9b06-d00bba427c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3efddd-5bc8-43b4-9b06-d00bba427c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc', 'volume_name': 'volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef16ef6d-0c89-4b10-8973-0bf5cbad1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef16ef6d-0c89-4b10-8973-0bf5cbad1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b060bb4c-f1a7-4488-931a-02d5756bb104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:35 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Volume c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc', 'volume_size': 1} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1003112296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add929d0070240e694ffaa1866f9e8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:35Z,use_quota=True,user_id='3d96fbec59c44a339d5e71be09d74a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Creating volume c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:09:35 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:09:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:35 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc 1073741824 Sep 28 15:09:35 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc 1073741824" returned: 0 in 1.303s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc Sep 28 15:09:37 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" returned: 0 in 0.670s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b060bb4c-f1a7-4488-931a-02d5756bb104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34a0520-9ebc-4a7e-a338-bcd800e9085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Volume volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc (c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc): created successfully Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34a0520-9ebc-4a7e-a338-bcd800e9085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Flow 'volume_create_manager' (b8c40014-133e-498f-9cb8-5b6eee1d9734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0d931489-e208-4297-a3b7-27508ace8787 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Created volume successfully. Sep 28 15:09:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Creating offline snapshot 954d2a8e-9d6a-4079-9e63-a8d9208894ff of volume c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:09:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[14807e15-7353-4248-a21a-3a87a77915a4]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:39 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc Sep 28 15:09:39 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:40 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" returned: 0 in 1.126s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:40 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:09:40 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:40 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff 1G Sep 28 15:09:40 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:41 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:09:41 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff 1G" returned: 0 in 1.025s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:41 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff Sep 28 15:09:41 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:42 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff" returned: 0 in 0.579s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:42 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff is being set with open permissions: ugo+rw Sep 28 15:09:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:42 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff Sep 28 15:09:42 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:42 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff" returned: 0 in 0.545s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:42 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info Sep 28 15:09:42 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:43 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info" returned: 0 in 0.455s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:43 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info is being set with open permissions: ugo+rw Sep 28 15:09:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:43 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info Sep 28 15:09:43 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:43 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.info" returned: 0 in 0.558s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.531s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a242a28c-548d-4abb-968f-cf2d9dad7e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Create snapshot completed successfully Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "cinder-954d2a8e-9d6a-4079-9e63-a8d9208894ff-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-954d2a8e-9d6a-4079-9e63-a8d9208894ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "cinder-quobyte-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-quobyte-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "cinder-quobyte-954d2a8e-9d6a-4079-9e63-a8d9208894ff" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-quobyte-954d2a8e-9d6a-4079-9e63-a8d9208894ff" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Deleting offline snapshot 954d2a8e-9d6a-4079-9e63-a8d9208894ff of volume c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] snapshot_file for this snap is: volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece71d10-5321-4034-9e8b-046fe1c2eb4a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:46 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff Sep 28 15:09:46 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:46 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff" returned: 0 in 0.729s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbaa8ca-131b-4ed0-a00e-f2c951d1d12d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:47 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc Sep 28 15:09:47 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:47 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" returned: 0 in 0.590s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:47 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff Sep 28 15:09:47 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:48 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff" returned: 0 in 0.617s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:48 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff Sep 28 15:09:48 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:48 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc.954d2a8e-9d6a-4079-9e63-a8d9208894ff" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-quobyte-954d2a8e-9d6a-4079-9e63-a8d9208894ff" released by "_delete_snapshot" :: held 2.603s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-quobyte-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" released by "delete_snapshot" :: held 2.646s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Created reservations ['c029111b-85cc-461e-8718-6581140adcae', 'e56aec31-48a6-4ef2-b915-3e8a72faa0e5', '888f9f94-ad9e-4d37-b773-033615bfee2d', 'dc595596-d74a-4254-8640-199c3f1aafa4'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Delete snapshot completed successfully. Sep 28 15:09:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cbc9597f-488d-4a05-beda-56bb6c28ee44 tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-954d2a8e-9d6a-4079-9e63-a8d9208894ff-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "cinder-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "cinder-quobyte-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-quobyte-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" acquired by "delete_volume" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[db42e017-10e1-415f-b284-3711c04cdc70]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:50 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc Sep 28 15:09:50 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:50 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" returned: 0 in 0.736s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:50 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc Sep 28 15:09:50 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:51 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" returned: 0 in 0.472s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-quobyte-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc" released by "delete_volume" :: held 1.371s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Created reservations ['78054ba0-71f4-47b2-a04b-f5ac2d5c799b', '235689f8-96ff-495b-a2bd-eb851eb9235f', '6a7d7e97-d719-4e65-95b5-f273a97a5b2a', 'c8c3ddb0-6e67-410c-9423-0e4e9101f595'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:51 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:09:51 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:51 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.487s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:51 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Deleted volume successfully. Sep 28 15:09:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2af5e689-d63c-44f7-a86a-301465b0db5e tempest-VolumeSnapshotQuotasNegativeTestJSON-476874770 None] Lock "cinder-c24d39c9-d0d6-4635-8c7b-6c3d64bf98dc-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:01 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=16 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:01 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=20,cinder:SELECT=16,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:07 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Flow 'volume_create_manager' (2362c245-dc21-4f01-8793-9b844bd09588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8e1fe3-ddaa-44be-bc26-55be09afb4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8e1fe3-ddaa-44be-bc26-55be09afb4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-516971526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0388da1-9aec-4574-86c1-7b8007e84f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdaa84d2b3d94bf692461928321a6c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:08Z,use_quota=True,user_id='389dcfae7dbf46769518f6d8603a7eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd753950-87bc-40d4-8562-6f54a27ba09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd753950-87bc-40d4-8562-6f54a27ba09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8b86a7-b46b-4cb6-8b48-d843869832c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8b86a7-b46b-4cb6-8b48-d843869832c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0388da1-9aec-4574-86c1-7b8007e84f3c', 'volume_name': 'volume-e0388da1-9aec-4574-86c1-7b8007e84f3c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130c1340-a256-4e60-8b2b-04caf6bf481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130c1340-a256-4e60-8b2b-04caf6bf481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51b2b2a-4f91-4cc8-a150-168e5f75c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Volume e0388da1-9aec-4574-86c1-7b8007e84f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0388da1-9aec-4574-86c1-7b8007e84f3c', 'volume_size': 1} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-516971526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0388da1-9aec-4574-86c1-7b8007e84f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdaa84d2b3d94bf692461928321a6c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:08Z,use_quota=True,user_id='389dcfae7dbf46769518f6d8603a7eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Creating volume e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:10:08 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:08 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c 1073741824 Sep 28 15:10:08 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:08 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c 1073741824" returned: 0 in 0.865s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:09 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c Sep 28 15:10:09 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:09 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c" returned: 0 in 0.352s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51b2b2a-4f91-4cc8-a150-168e5f75c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0388da1-9aec-4574-86c1-7b8007e84f3c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2a525f-5b69-4a44-9905-c4e5d604bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Volume volume-e0388da1-9aec-4574-86c1-7b8007e84f3c (e0388da1-9aec-4574-86c1-7b8007e84f3c): created successfully Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2a525f-5b69-4a44-9905-c4e5d604bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Flow 'volume_create_manager' (2362c245-dc21-4f01-8793-9b844bd09588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7c57f720-8aac-4cf9-98f9-83edf76ae75f tempest-SnapshotMetadataTestJSON-640883728 None] Created volume successfully. Sep 28 15:10:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Creating offline snapshot 6a231f70-ce21-404c-871a-368a1859565e of volume e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:10 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d23f2-d330-443a-bbc3-ad1e8d39ea83]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:10 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c Sep 28 15:10:10 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:11 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c" returned: 0 in 0.613s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:11 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e 1G Sep 28 15:10:11 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:11 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e 1G" returned: 0 in 0.782s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0388da1-9aec-4574-86c1-7b8007e84f3c -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0388da1-9aec-4574-86c1-7b8007e84f3c -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e Sep 28 15:10:12 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0388da1-9aec-4574-86c1-7b8007e84f3c -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e" returned: 0 in 0.564s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e is being set with open permissions: ugo+rw Sep 28 15:10:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e Sep 28 15:10:12 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e" returned: 0 in 0.381s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info Sep 28 15:10:13 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:13 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info" returned: 0 in 0.386s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info is being set with open permissions: ugo+rw Sep 28 15:10:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:13 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info Sep 28 15:10:13 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:13 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.info" returned: 0 in 0.488s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ac400766-dded-420f-9b7a-5ad372be0a94 tempest-SnapshotMetadataTestJSON-640883728 None] Create snapshot completed successfully Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "cinder-6a231f70-ce21-404c-871a-368a1859565e-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-6a231f70-ce21-404c-871a-368a1859565e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "cinder-quobyte-e0388da1-9aec-4574-86c1-7b8007e84f3c" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-quobyte-e0388da1-9aec-4574-86c1-7b8007e84f3c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "cinder-quobyte-6a231f70-ce21-404c-871a-368a1859565e" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-quobyte-6a231f70-ce21-404c-871a-368a1859565e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Deleting offline snapshot 6a231f70-ce21-404c-871a-368a1859565e of volume e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] snapshot_file for this snap is: volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac6911e-8627-4d44-af16-1669f2be12dd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:16 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e Sep 28 15:10:16 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:16 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e" returned: 0 in 0.648s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0388da1-9aec-4574-86c1-7b8007e84f3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a458ec20-6f40-4f76-9d72-55bc50fdf005]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c Sep 28 15:10:17 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c" returned: 0 in 0.616s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e Sep 28 15:10:17 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e" returned: 0 in 0.577s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:18 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e Sep 28 15:10:18 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c.6a231f70-ce21-404c-871a-368a1859565e" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-quobyte-6a231f70-ce21-404c-871a-368a1859565e" released by "_delete_snapshot" :: held 2.473s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-quobyte-e0388da1-9aec-4574-86c1-7b8007e84f3c" released by "delete_snapshot" :: held 2.504s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Created reservations ['6cfdbc7f-70e2-4484-b5f2-34a80077b9bf', 'eee56672-752e-4133-bdbd-f8e0a810f080', '98ae125f-7354-4ca1-b27f-c40e7b33c6a0', 'be09db88-787b-49d1-8925-cdc5b8a42165'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:18 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Delete snapshot completed successfully. Sep 28 15:10:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-993991e9-748a-48c6-9d9b-71d7e5c152b4 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-6a231f70-ce21-404c-871a-368a1859565e-delete_snapshot" released by "delete_snapshot" :: held 2.833s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "cinder-e0388da1-9aec-4574-86c1-7b8007e84f3c-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-e0388da1-9aec-4574-86c1-7b8007e84f3c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "cinder-quobyte-e0388da1-9aec-4574-86c1-7b8007e84f3c" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-quobyte-e0388da1-9aec-4574-86c1-7b8007e84f3c" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c881eb-cd2c-4c1b-8544-dfa0dc232358]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c Sep 28 15:10:20 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c" returned: 0 in 0.559s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c Sep 28 15:10:20 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e0388da1-9aec-4574-86c1-7b8007e84f3c" returned: 0 in 0.495s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-quobyte-e0388da1-9aec-4574-86c1-7b8007e84f3c" released by "delete_volume" :: held 1.191s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:20 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Created reservations ['7b2ffed6-a2ab-4f3f-904c-f6e302706dd0', 'ee86cc3f-c203-4f25-aa61-281a937ba246', '802f5c1f-7bff-45a5-a8d5-cb374ddf0b7e', '76f2dcf9-551a-485d-8caa-f11aa5852426'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:10:21 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.380s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Deleted volume successfully. Sep 28 15:10:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-862b53ff-e936-45c0-9c17-ffc0834ce0b1 tempest-SnapshotMetadataTestJSON-640883728 None] Lock "cinder-e0388da1-9aec-4574-86c1-7b8007e84f3c-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Flow 'volume_create_manager' (cb3596d8-d2c9-44e3-b924-05311bb79d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616d3847-ab14-49c0-9813-98e95bbeff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616d3847-ab14-49c0-9813-98e95bbeff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734885656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5760a698-5628-4ec8-9372-a05340341d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fdae93b0d64334af90175af9ff4160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:30Z,use_quota=True,user_id='d34caf6a82d0433d9eb2fc1a7b73f05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d00370c-f1bb-49c9-80b5-c4ac310e5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d00370c-f1bb-49c9-80b5-c4ac310e5395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2564fadc-b087-4d18-ae86-55140c6b1d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2564fadc-b087-4d18-ae86-55140c6b1d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5760a698-5628-4ec8-9372-a05340341d5d', 'volume_name': 'volume-5760a698-5628-4ec8-9372-a05340341d5d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ca2a2a-a1af-4c8b-9785-5456ff16da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ca2a2a-a1af-4c8b-9785-5456ff16da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0af10e-199d-4235-8003-ced4369035fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Volume 5760a698-5628-4ec8-9372-a05340341d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5760a698-5628-4ec8-9372-a05340341d5d', 'volume_size': 1} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734885656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5760a698-5628-4ec8-9372-a05340341d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fdae93b0d64334af90175af9ff4160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:30Z,use_quota=True,user_id='d34caf6a82d0433d9eb2fc1a7b73f05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Creating volume 5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:10:30 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:10:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:30 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d 1073741824 Sep 28 15:10:30 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d 1073741824" returned: 0 in 0.781s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:31 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d Sep 28 15:10:31 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d" returned: 0 in 0.458s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0af10e-199d-4235-8003-ced4369035fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5760a698-5628-4ec8-9372-a05340341d5d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce403d-184b-4768-b27f-2724a155a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Volume volume-5760a698-5628-4ec8-9372-a05340341d5d (5760a698-5628-4ec8-9372-a05340341d5d): created successfully Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce403d-184b-4768-b27f-2724a155a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Flow 'volume_create_manager' (cb3596d8-d2c9-44e3-b924-05311bb79d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8140e6a4-dd9e-4476-93a1-0f097ac8c70d tempest-VolumesDeleteCascade-152553286 None] Created volume successfully. Sep 28 15:10:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Creating offline snapshot d43caf1b-de1a-4fa3-8c0f-740d2905873c of volume 5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:32 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb703788-f766-4306-b9ac-facf7c2d6dbb]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d Sep 28 15:10:32 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d" returned: 0 in 0.479s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c 1G Sep 28 15:10:33 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c 1G" returned: 0 in 0.643s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5760a698-5628-4ec8-9372-a05340341d5d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5760a698-5628-4ec8-9372-a05340341d5d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:33 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5760a698-5628-4ec8-9372-a05340341d5d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 0.498s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c is being set with open permissions: ugo+rw Sep 28 15:10:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:34 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 0.566s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info Sep 28 15:10:35 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Flow 'volume_create_manager' (1474252e-dba2-4088-aef5-4d0b06a39dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9034ef-df00-4631-abe7-90c612c9949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9034ef-df00-4631-abe7-90c612c9949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-333180968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ca2da6-4fbb-4df6-a33c-20afd341d850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fab8c5a87a2411491404788048974da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:35Z,use_quota=True,user_id='3ddf40e453a645b6beb5b2fc02836681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:35 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4933c20a-788c-43d2-a8bb-25abfc8fe0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4933c20a-788c-43d2-a8bb-25abfc8fe0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8d4ba5-4c86-48eb-92d5-d37581dbe632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8d4ba5-4c86-48eb-92d5-d37581dbe632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ca2da6-4fbb-4df6-a33c-20afd341d850', 'volume_name': 'volume-22ca2da6-4fbb-4df6-a33c-20afd341d850', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32859ba-141a-48b8-a59b-e191cb49f379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32859ba-141a-48b8-a59b-e191cb49f379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe1a41d-a409-4ce1-9581-905143125337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:35 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Volume 22ca2da6-4fbb-4df6-a33c-20afd341d850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ca2da6-4fbb-4df6-a33c-20afd341d850', 'volume_size': 1} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info" returned: 0 in 0.737s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info is being set with open permissions: ugo+rw Sep 28 15:10:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info Sep 28 15:10:35 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.info" returned: 0 in 0.553s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.809s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-333180968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ca2da6-4fbb-4df6-a33c-20afd341d850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fab8c5a87a2411491404788048974da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:35Z,use_quota=True,user_id='3ddf40e453a645b6beb5b2fc02836681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Creating volume 22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:10:36 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:10:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 1073741824 Sep 28 15:10:36 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c19b7aa3-3d83-419f-88c7-20a32655f0f0 tempest-VolumesDeleteCascade-152553286 None] Create snapshot completed successfully Sep 28 15:10:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:37 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 1073741824" returned: 0 in 1.029s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:10:37 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.575s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.679s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe1a41d-a409-4ce1-9581-905143125337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ca2da6-4fbb-4df6-a33c-20afd341d850', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b1ae47-4c32-4c84-8d4a-4d7492f1e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Creating offline snapshot 4b61d333-81d7-4a21-bc18-d306f489a150 of volume 5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:38 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Volume volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 (22ca2da6-4fbb-4df6-a33c-20afd341d850): created successfully Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b1ae47-4c32-4c84-8d4a-4d7492f1e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Flow 'volume_create_manager' (1474252e-dba2-4088-aef5-4d0b06a39dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2809b2-a7fd-4773-b131-5389687de48b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-17c539a3-f29d-4755-8740-6eb43b773d07 tempest-TestStampPattern-237515929 None] Created volume successfully. Sep 28 15:10:38 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:38 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 0.780s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5760a698-5628-4ec8-9372-a05340341d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:39 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 1G Sep 28 15:10:39 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 1G" returned: 0 in 1.223s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:40 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 Sep 28 15:10:40 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:10:40 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:41 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.012s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:10:41 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150" returned: 0 in 1.282s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:41 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 is being set with open permissions: ugo+rw Sep 28 15:10:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:41 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 Sep 28 15:10:41 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150" returned: 0 in 0.825s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-98128a09-2d81-4018-9a64-c0d7fd1e35af tempest-VolumesDeleteCascade-152553286 None] Create snapshot completed successfully Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-5760a698-5628-4ec8-9372-a05340341d5d-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-5760a698-5628-4ec8-9372-a05340341d5d-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Performing cascade delete. {{(pid=86888) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-4b61d333-81d7-4a21-bc18-d306f489a150-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-4b61d333-81d7-4a21-bc18-d306f489a150-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-4b61d333-81d7-4a21-bc18-d306f489a150" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-4b61d333-81d7-4a21-bc18-d306f489a150" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Deleting offline snapshot 4b61d333-81d7-4a21-bc18-d306f489a150 of volume 5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] snapshot_file for this snap is: volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c3ae3-4fd6-41c7-a354-c2d92e7040d5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 Sep 28 15:10:44 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150" returned: 0 in 1.207s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5760a698-5628-4ec8-9372-a05340341d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:45 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ad82d-cf2f-458b-b925-c8dd9d330613]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:45 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:45 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:46 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 1.021s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5760a698-5628-4ec8-9372-a05340341d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 Sep 28 15:10:46 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (e5c2dabb-c748-4c67-acdb-f54125312471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a596db-d863-443e-b6e2-05c1796263f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a596db-d863-443e-b6e2-05c1796263f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236368346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8f1723-4e44-4e89-a421-9a98a7d1174c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:46Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15330fd-69a1-4d33-80b2-29ad5cd4070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15330fd-69a1-4d33-80b2-29ad5cd4070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea2880d-1c5c-4e20-9321-49a0d0903378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea2880d-1c5c-4e20-9321-49a0d0903378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8f1723-4e44-4e89-a421-9a98a7d1174c', 'volume_name': 'volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2fc89b-6f2a-4d76-be36-8e87f900943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2fc89b-6f2a-4d76-be36-8e87f900943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86567bbc-0a49-4a6e-b1a1-9c57b92cc139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Volume dc8f1723-4e44-4e89-a421-9a98a7d1174c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c', 'volume_size': 1} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236368346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8f1723-4e44-4e89-a421-9a98a7d1174c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:46Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Creating volume dc8f1723-4e44-4e89-a421-9a98a7d1174c {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:10:46 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:10:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c 1073741824 Sep 28 15:10:47 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150" returned: 0 in 1.445s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150 Sep 28 15:10:47 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c 1073741824" returned: 0 in 1.476s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.4b61d333-81d7-4a21-bc18-d306f489a150" returned: 0 in 0.630s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-4b61d333-81d7-4a21-bc18-d306f489a150" released by "_delete_snapshot" :: held 4.624s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" released by "delete_snapshot" :: held 4.719s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:48 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c Sep 28 15:10:48 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Created reservations ['3de34ae7-9849-4f38-b40e-7ce5bd4290e0', '978dc468-7474-4a45-9533-843affa94556', '3e75cf6f-52ed-4d75-a6e2-b43a4308f92a', '7e76c6f1-20bd-4644-a804-3d38a8a34957'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Delete snapshot completed successfully. Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-4b61d333-81d7-4a21-bc18-d306f489a150-delete_snapshot" released by "delete_snapshot" :: held 5.444s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-d43caf1b-de1a-4fa3-8c0f-740d2905873c-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-d43caf1b-de1a-4fa3-8c0f-740d2905873c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-d43caf1b-de1a-4fa3-8c0f-740d2905873c" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-d43caf1b-de1a-4fa3-8c0f-740d2905873c" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Deleting offline snapshot d43caf1b-de1a-4fa3-8c0f-740d2905873c of volume 5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] snapshot_file for this snap is: volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:49 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5773732-a24e-4b35-adf9-73a0970dd553]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c" returned: 0 in 1.046s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] <== create_volume: return (2800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.808s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86567bbc-0a49-4a6e-b1a1-9c57b92cc139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e187e323-4e24-4941-ab92-d47d3e2e9d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:49 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:49 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Volume volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c (dc8f1723-4e44-4e89-a421-9a98a7d1174c): created successfully Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e187e323-4e24-4941-ab92-d47d3e2e9d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (e5c2dabb-c748-4c67-acdb-f54125312471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:50 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cbac6bb0-e126-4613-aa20-3abc967c01c8 tempest-VolumesActionsTest-26859753 None] Created volume successfully. Sep 28 15:10:50 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 0.921s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5760a698-5628-4ec8-9372-a05340341d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:50 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf05d2-5f30-469c-afae-54d31525962f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:50 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d Sep 28 15:10:50 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a03fca39-c32c-4add-9b02-0dad1ae417bd tempest-VolumesActionsTest-26859753 None] Acquiring lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c" by "attach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a03fca39-c32c-4add-9b02-0dad1ae417bd tempest-VolumesActionsTest-26859753 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c" acquired by "attach_volume" :: waited 0.047s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a03fca39-c32c-4add-9b02-0dad1ae417bd tempest-VolumesActionsTest-26859753 None] Attaching volume dc8f1723-4e44-4e89-a421-9a98a7d1174c to instance 929ded24-b4ef-492f-a31b-89b1e6c081a0 at mountpoint /dev/vdb on host None. Sep 28 15:10:51 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d" returned: 0 in 0.915s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a03fca39-c32c-4add-9b02-0dad1ae417bd tempest-VolumesActionsTest-26859753 None] Attach volume completed successfully. Sep 28 15:10:51 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:51 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a03fca39-c32c-4add-9b02-0dad1ae417bd tempest-VolumesActionsTest-26859753 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c" released by "attach_volume" :: held 0.375s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:52 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 0.997s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c Sep 28 15:10:52 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d.d43caf1b-de1a-4fa3-8c0f-740d2905873c" returned: 0 in 0.565s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-d43caf1b-de1a-4fa3-8c0f-740d2905873c" released by "_delete_snapshot" :: held 3.734s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" released by "delete_snapshot" :: held 3.820s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Created reservations ['1a763753-c62a-4d04-b1be-03050f1d850b', 'bafa8b0a-5945-4b69-bc18-8a25e0d9137e', 'd434b6ea-dab3-42d9-b244-2f3b07fd51b4', 'a805af51-ed58-4aeb-9434-eb23a92c6fb7'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-05d38e97-24f5-438e-984f-9b4d4691ba36 tempest-VolumesActionsTest-1597564065 None] Terminate volume connection completed successfully. Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05d38e97-24f5-438e-984f-9b4d4691ba36 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-detach_volume" by "detach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Delete snapshot completed successfully. Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05d38e97-24f5-438e-984f-9b4d4691ba36 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-d43caf1b-de1a-4fa3-8c0f-740d2905873c-delete_snapshot" released by "delete_snapshot" :: held 4.321s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Snapshots deleted, issuing volume delete {{(pid=86888) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-05d38e97-24f5-438e-984f-9b4d4691ba36 tempest-VolumesActionsTest-1597564065 None] Detaching volume dc8f1723-4e44-4e89-a421-9a98a7d1174c from instance 929ded24-b4ef-492f-a31b-89b1e6c081a0. Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cbc784-148a-4d07-a756-764d41eb3a42]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-05d38e97-24f5-438e-984f-9b4d4691ba36 tempest-VolumesActionsTest-1597564065 None] Detach volume completed successfully. Sep 28 15:10:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-05d38e97-24f5-438e-984f-9b4d4691ba36 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-detach_volume" released by "detach_volume" :: held 0.265s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:54 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d Sep 28 15:10:54 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a0d719a1-0cd8-433c-b7d3-676f885717de tempest-VolumesActionsTest-26859753 None] Acquiring lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-detach_volume" by "detach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a0d719a1-0cd8-433c-b7d3-676f885717de tempest-VolumesActionsTest-26859753 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a0d719a1-0cd8-433c-b7d3-676f885717de tempest-VolumesActionsTest-26859753 None] Volume detach called, but volume not attached. Sep 28 15:10:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a0d719a1-0cd8-433c-b7d3-676f885717de tempest-VolumesActionsTest-26859753 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:54 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d" returned: 0 in 0.915s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:54 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d Sep 28 15:10:54 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Acquiring lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Acquiring lock "cinder-quobyte-dc8f1723-4e44-4e89-a421-9a98a7d1174c" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Lock "cinder-quobyte-dc8f1723-4e44-4e89-a421-9a98a7d1174c" acquired by "delete_volume" :: waited 0.074s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:55 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5760a698-5628-4ec8-9372-a05340341d5d" returned: 0 in 0.720s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[df331435-720b-4815-9b75-126869cf491a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-5760a698-5628-4ec8-9372-a05340341d5d" released by "delete_volume" :: held 1.825s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:55 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Created reservations ['958b98ec-8355-4efa-a81b-1838a9343ac8', '13e820b5-6dc2-4564-9e71-74541335a74b', '08281373-f609-4af3-bcf4-43ba5e69f89c', '04cd1b1b-0b23-45b3-af20-d8e88f1e6ddf'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:56 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c Sep 28 15:10:56 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:56 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:10:56 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:57 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c" returned: 0 in 1.835s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:57 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c Sep 28 15:10:57 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:57 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.315s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:57 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Deleted volume successfully. Sep 28 15:10:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1a766383-025e-456b-8dc8-e525ad67e2c4 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-5760a698-5628-4ec8-9372-a05340341d5d-delete_volume" released by "delete_volume" :: held 14.014s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:58 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dc8f1723-4e44-4e89-a421-9a98a7d1174c" returned: 0 in 0.899s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Lock "cinder-quobyte-dc8f1723-4e44-4e89-a421-9a98a7d1174c" released by "delete_volume" :: held 2.900s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Created reservations ['e2e03cc0-d2f1-4ee1-90be-b4ca52775c4b', '17b2ae12-bdd8-4332-8ebc-40282ac6d0cb', '400f4bf9-f2e9-4300-9e34-ab14fd41e2fc', 'fd58e715-76e9-41f6-8051-11f74effed18'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:58 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:10:58 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Flow 'volume_create_manager' (60628e9e-055d-4368-892c-aff54f9a1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a116890-af8a-4e9a-a227-2c4a250c4c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:59 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.688s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a116890-af8a-4e9a-a227-2c4a250c4c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1412153234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e804b8-b433-4ea7-9779-45ff28d8be59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fdae93b0d64334af90175af9ff4160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:59Z,use_quota=True,user_id='d34caf6a82d0433d9eb2fc1a7b73f05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3532dd7d-2ad4-45b3-ba97-803ef8378528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3532dd7d-2ad4-45b3-ba97-803ef8378528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b353e8-c99d-4c02-b54a-7ae9b01ab883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b353e8-c99d-4c02-b54a-7ae9b01ab883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e804b8-b433-4ea7-9779-45ff28d8be59', 'volume_name': 'volume-b1e804b8-b433-4ea7-9779-45ff28d8be59', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8125525f-7ed0-4abc-b4a4-f0793ebfffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8125525f-7ed0-4abc-b4a4-f0793ebfffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a368d8-47cc-4811-8a8c-dc9060219710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:59 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Volume b1e804b8-b433-4ea7-9779-45ff28d8be59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e804b8-b433-4ea7-9779-45ff28d8be59', 'volume_size': 1} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1412153234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e804b8-b433-4ea7-9779-45ff28d8be59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fdae93b0d64334af90175af9ff4160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:59Z,use_quota=True,user_id='d34caf6a82d0433d9eb2fc1a7b73f05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Creating volume b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:10:59 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Deleted volume successfully. Sep 28 15:10:59 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 1073741824 Sep 28 15:10:59 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ab72136f-ffc3-4dfa-a752-68f431b71ed7 tempest-VolumesActionsTest-26859753 None] Lock "cinder-dc8f1723-4e44-4e89-a421-9a98a7d1174c-delete_volume" released by "delete_volume" :: held 4.422s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:00 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 1073741824" returned: 0 in 0.885s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:00 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:00 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:01 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.721s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a368d8-47cc-4811-8a8c-dc9060219710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e804b8-b433-4ea7-9779-45ff28d8be59', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e95787-5dbb-4e9b-aca9-11b4c6bf5d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:01 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Volume volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 (b1e804b8-b433-4ea7-9779-45ff28d8be59): created successfully Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e95787-5dbb-4e9b-aca9-11b4c6bf5d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Flow 'volume_create_manager' (60628e9e-055d-4368-892c-aff54f9a1137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-24a9ffe4-89d6-45f8-8f8e-f8ecbba27d9a tempest-VolumesDeleteCascade-152553286 None] Created volume successfully. Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=51,cinder:UPDATE=60,cinder:INSERT=13,cinder:DELETE=7 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=68,cinder:SELECT=67,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Creating offline snapshot 4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb of volume b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e09b642-fd87-4de2-af31-2a287718c768]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:03 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:03 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:03 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.689s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:03 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb 1G Sep 28 15:11:03 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:04 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb 1G" returned: 0 in 0.683s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:04 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb Sep 28 15:11:04 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:04 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (fccbae47-b16f-4d06-9f74-5a6f74cec2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa9875b-8b11-49fe-bcc0-b6c18edde5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa9875b-8b11-49fe-bcc0-b6c18edde5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979515896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:05Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b74c23c-9b36-4502-9d0b-d860ae8239f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b74c23c-9b36-4502-9d0b-d860ae8239f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768c9723-f53b-435c-9ab0-ba4b7f180c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768c9723-f53b-435c-9ab0-ba4b7f180c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2', 'volume_name': 'volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4134d7-58cf-4a6f-94d6-8ed5657cc8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4134d7-58cf-4a6f-94d6-8ed5657cc8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9eac28-e3b6-4a11-bdb5-556bf7f37f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Volume 8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2', 'volume_size': 1} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:05 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" returned: 0 in 0.645s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:05 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb is being set with open permissions: ugo+rw Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:05 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb Sep 28 15:11:05 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:05 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" returned: 0 in 0.538s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:05 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info Sep 28 15:11:05 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:06 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:06 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info is being set with open permissions: ugo+rw Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:06 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info Sep 28 15:11:06 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:06 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.info" returned: 0 in 0.470s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979515896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:05Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Creating volume 8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:06 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:06 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 1073741824 Sep 28 15:11:06 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4baec1a7-6b60-4fe8-bd11-6c91c6b83eda tempest-VolumesDeleteCascade-152553286 None] Create snapshot completed successfully Sep 28 15:11:07 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 1073741824" returned: 0 in 0.938s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:07 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 Sep 28 15:11:07 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:08 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2" returned: 0 in 0.443s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9eac28-e3b6-4a11-bdb5-556bf7f37f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b2ecc2-7f19-4068-8a5c-4a1c91beade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Volume volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 (8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2): created successfully Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b2ecc2-7f19-4068-8a5c-4a1c91beade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (fccbae47-b16f-4d06-9f74-5a6f74cec2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d2ae582c-7445-4a35-ac2f-f5fb7d9a375b tempest-VolumesActionsTest-26859753 None] Created volume successfully. Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Flow 'volume_create_manager' (5695ec70-a8c8-4487-86ab-ee52c79528a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe92acf-316d-4465-ab3c-5ad138066f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe92acf-316d-4465-ab3c-5ad138066f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292124633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411058e0-7544-4d35-85cc-bf5677830006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fdae93b0d64334af90175af9ff4160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:09Z,use_quota=True,user_id='d34caf6a82d0433d9eb2fc1a7b73f05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788d5abc-2c82-40ab-bf20-15059a282f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788d5abc-2c82-40ab-bf20-15059a282f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f38e7a-aefb-49c5-a832-1e32396c06e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f38e7a-aefb-49c5-a832-1e32396c06e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '411058e0-7544-4d35-85cc-bf5677830006', 'volume_name': 'volume-411058e0-7544-4d35-85cc-bf5677830006', 'volume_size': 1, 'snapshot_id': '4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efcb576-d982-416f-a567-7539b26d209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efcb576-d982-416f-a567-7539b26d209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979d2f39-324f-4ea9-8a56-1cef2017a219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Volume 411058e0-7544-4d35-85cc-bf5677830006: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-411058e0-7544-4d35-85cc-bf5677830006', 'volume_size': 1, 'snapshot_id': '4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb'} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb-411058e0-7544-4d35-85cc-bf5677830006" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb-411058e0-7544-4d35-85cc-bf5677830006" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Creating volume 411058e0-7544-4d35-85cc-bf5677830006 from snapshot 4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-411058e0-7544-4d35-85cc-bf5677830006" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-411058e0-7544-4d35-85cc-bf5677830006" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] snapshot: 4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb, volume: 411058e0-7544-4d35-85cc-bf5677830006, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d6d7ae-e565-441b-b115-19c863a992cb]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb Sep 28 15:11:09 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:09 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1e804b8-b433-4ea7-9779-45ff28d8be59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f793f22c-1f65-40de-b7bf-0e7360934c2e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:09 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Lock "cinder-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-quobyte-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[600a4f0b-6523-405e-9151-b0c1f6cf80d9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.515s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:11:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:09 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 Sep 28 15:11:09 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:09 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 Sep 28 15:11:09 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:10 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2" returned: 0 in 0.468s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:10 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2 Sep 28 15:11:10 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:11 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2" returned: 0 in 0.950s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2" released by "delete_volume" :: held 1.502s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Flow 'volume_create_manager' (6dcd323a-4f9e-45aa-ba32-8578f8df2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e02f655-d4e7-454d-868e-64d4cd3dd1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e02f655-d4e7-454d-868e-64d4cd3dd1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1133454088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9552b253-81d9-4c02-b3d6-0ed70ace1b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782749754f094414b7471c08a96c3b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:11Z,use_quota=True,user_id='42262b7c4b9c4fd48e2888159148706a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcbb494-38ce-4d28-8c4f-59ab5b86bb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcbb494-38ce-4d28-8c4f-59ab5b86bb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8924311-f877-4b4b-9876-02706eaac21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8924311-f877-4b4b-9876-02706eaac21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9552b253-81d9-4c02-b3d6-0ed70ace1b08', 'volume_name': 'volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ada348c-ec99-45df-9e08-2712d06cb7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ada348c-ec99-45df-9e08-2712d06cb7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8ff6df-9ce3-4539-af3f-d53dde01f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Volume 9552b253-81d9-4c02-b3d6-0ed70ace1b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08', 'volume_size': 1} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Created reservations ['574abc0a-59d8-46a5-9f63-2e0aae954914', 'f42a8a2f-eae0-467c-8d67-56e463a82374', '12abbeb4-47a9-4190-8395-8187cfc40d6d', 'c8954139-c7ef-4d3b-801f-12068e72d93d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:11 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:11 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:12 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.883s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:12 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Deleted volume successfully. Sep 28 15:11:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-165d9591-31a0-4ed6-ac18-a1d54518dd9b tempest-VolumesActionsTest-1597564065 None] Lock "cinder-8ce5a95d-6e7c-4427-9376-2d10a8fbb1a2-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (48bfeb59-9506-46ba-aa61-678d87dd2d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41afe00c-3bfe-4908-ad87-5d9a98ceb3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41afe00c-3bfe-4908-ad87-5d9a98ceb3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231338867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ec3c5e-22c8-4e14-8d76-efbe983a7e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:14Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8efbfea-a7b0-4902-b331-5e3383f17125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8efbfea-a7b0-4902-b331-5e3383f17125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bacd92-ed2e-4d5d-96cf-9db7d2b28d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bacd92-ed2e-4d5d-96cf-9db7d2b28d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ec3c5e-22c8-4e14-8d76-efbe983a7e7e', 'volume_name': 'volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00deceb9-de5a-4ae0-b6f8-9ce9000c802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00deceb9-de5a-4ae0-b6f8-9ce9000c802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4e318f-05e9-452a-8d45-bab36ddc448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Volume 97ec3c5e-22c8-4e14-8d76-efbe983a7e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e', 'volume_size': 1} Sep 28 15:11:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:18 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006" returned: 0 in 8.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b305c-12ad-4749-8252-d6659b732bd6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:18 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:18 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:18 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.556s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:18 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:11:18 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Converted 1024.00 MB image at 122.15 MB/s Sep 28 15:11:18 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 is being set with open permissions: ugo+rw Sep 28 15:11:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:18 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 Sep 28 15:11:18 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:19 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006" returned: 0 in 0.314s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-411058e0-7544-4d35-85cc-bf5677830006" released by "_copy_volume_from_snapshot" :: held 10.292s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb-411058e0-7544-4d35-85cc-bf5677830006" released by "_create_volume_from_snapshot" :: held 10.327s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.348s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.545s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1133454088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9552b253-81d9-4c02-b3d6-0ed70ace1b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782749754f094414b7471c08a96c3b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:11Z,use_quota=True,user_id='42262b7c4b9c4fd48e2888159148706a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Creating volume 9552b253-81d9-4c02-b3d6-0ed70ace1b08 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:19 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:19 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 1073741824 Sep 28 15:11:19 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979d2f39-324f-4ea9-8a56-1cef2017a219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411058e0-7544-4d35-85cc-bf5677830006', 'volume_size': 1, 'snapshot_id': '4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6814af9c-bb81-459c-8007-f38faa0cfc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:19 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Volume volume-411058e0-7544-4d35-85cc-bf5677830006 (411058e0-7544-4d35-85cc-bf5677830006): created successfully Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6814af9c-bb81-459c-8007-f38faa0cfc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Flow 'volume_create_manager' (5695ec70-a8c8-4487-86ab-ee52c79528a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-49141785-04bd-4d97-b292-936845f0e5c7 tempest-VolumesDeleteCascade-152553286 None] Created volume successfully. Sep 28 15:11:19 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 1073741824" returned: 0 in 0.528s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:19 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 Sep 28 15:11:19 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08" returned: 0 in 0.300s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231338867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ec3c5e-22c8-4e14-8d76-efbe983a7e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:14Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Creating volume 97ec3c5e-22c8-4e14-8d76-efbe983a7e7e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:20 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8ff6df-9ce3-4539-af3f-d53dde01f644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a03e02b-c5a0-4c89-a4db-e6ccb89f4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:20 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e 1073741824 Sep 28 15:11:20 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Volume volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 (9552b253-81d9-4c02-b3d6-0ed70ace1b08): created successfully Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a03e02b-c5a0-4c89-a4db-e6ccb89f4980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Flow 'volume_create_manager' (6dcd323a-4f9e-45aa-ba32-8578f8df2051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:20 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e930ee73-4763-4fc8-8dca-4b2c965e48db tempest-AttachVolumeTestJSON-915533788 None] Created volume successfully. Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-b1e804b8-b433-4ea7-9779-45ff28d8be59-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-b1e804b8-b433-4ea7-9779-45ff28d8be59-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Performing cascade delete. {{(pid=86888) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-b1e804b8-b433-4ea7-9779-45ff28d8be59" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-b1e804b8-b433-4ea7-9779-45ff28d8be59" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Deleting offline snapshot 4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb of volume b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] snapshot_file for this snap is: volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4559ceb4-5c6c-4dd4-bf96-3b67a29676c6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb Sep 28 15:11:20 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:20 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e 1073741824" returned: 0 in 0.630s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:20 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e Sep 28 15:11:20 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" returned: 0 in 0.474s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1e804b8-b433-4ea7-9779-45ff28d8be59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:21 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e" returned: 0 in 0.307s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b786c17-2819-427b-907a-aa717f7ee90c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4e318f-05e9-452a-8d45-bab36ddc448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc851f6e-247c-4782-b35f-a64131bb31a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:21 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Volume volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e (97ec3c5e-22c8-4e14-8d76-efbe983a7e7e): created successfully Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc851f6e-247c-4782-b35f-a64131bb31a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (48bfeb59-9506-46ba-aa61-678d87dd2d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6e576f92-0a7c-42ca-b489-951d75ddd278 tempest-VolumesActionsTest-26859753 None] Created volume successfully. Sep 28 15:11:21 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:21 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:21 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.580s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:21 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb Sep 28 15:11:21 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Lock "cinder-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-quobyte-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:22 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" returned: 0 in 0.657s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb Sep 28 15:11:22 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e" acquired by "delete_volume" :: waited 0.052s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae5e4e1-c74f-4085-ad66-998301185303]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:22 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e Sep 28 15:11:22 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac67cb-b866-4e57-aecd-1bb06734598c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59.4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" returned: 0 in 0.416s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb" released by "_delete_snapshot" :: held 2.268s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-b1e804b8-b433-4ea7-9779-45ff28d8be59" released by "delete_snapshot" :: held 2.294s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:22 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 Sep 28 15:11:22 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Created reservations ['effd95d5-e3bc-4b5c-8985-16fcd74f2540', 'c46d0d07-87c1-4ad2-afd1-58569c8fb2e7', 'e66fa751-7aa7-45e3-9b63-47eb04c3d59a', '32992412-0825-4ed5-82f8-8dbdfc23da97'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:22 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e" returned: 0 in 0.553s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:22 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e Sep 28 15:11:22 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Delete snapshot completed successfully. Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-4ff9e5e2-c0cc-45ad-9649-b0753c11fbfb-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Snapshots deleted, issuing volume delete {{(pid=86888) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-b1e804b8-b433-4ea7-9779-45ff28d8be59" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-b1e804b8-b433-4ea7-9779-45ff28d8be59" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a0185-3efa-4d77-8225-07a2747aeaf0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08" returned: 0 in 0.641s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.669s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:23 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:23 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c7095bf-a206-4672-951e-ebff62620e98', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:11:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-b6c0a01f-97bd-4d1e-9fa2-9d77f567e630 req-b2ed52d8-e861-47eb-854f-70474a946b14 tempest-AttachVolumeTestJSON-915533788 None] attachment_update completed successfully. Sep 28 15:11:23 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e" returned: 0 in 0.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e" released by "delete_volume" :: held 1.110s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Created reservations ['7f6421e1-e522-4ee6-9c87-968330007f74', '8713d6ac-d937-4b50-8387-add66f0222cb', '14a6776e-7757-41c3-8a1f-34839f1e4446', 'c4b5599e-aea9-4c44-ab41-fb8d7ba61953'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.787s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:23 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59 Sep 28 15:11:23 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:24 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.343s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Deleted volume successfully. Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f397c992-ca08-4cfc-9994-09b3a10a8eaf tempest-VolumesActionsTest-1597564065 None] Lock "cinder-97ec3c5e-22c8-4e14-8d76-efbe983a7e7e-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:24 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b1e804b8-b433-4ea7-9779-45ff28d8be59" returned: 0 in 0.358s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-b1e804b8-b433-4ea7-9779-45ff28d8be59" released by "delete_volume" :: held 1.237s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Created reservations ['df4efab6-3d6e-47d8-9c5c-ed6f22784baf', '9fbc1123-d29a-45e2-9405-c494ffcf9283', 'fad6e19e-bae4-4cb3-a1a3-c64eeee2403a', '0fef6367-f69e-4835-915d-d89b1ea43d09'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:24 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:24 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.408s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Deleted volume successfully. Sep 28 15:11:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-558b4fed-50ec-444b-83f2-1f6cbcff17c1 tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-b1e804b8-b433-4ea7-9779-45ff28d8be59-delete_volume" released by "delete_volume" :: held 4.540s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-411058e0-7544-4d35-85cc-bf5677830006-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-411058e0-7544-4d35-85cc-bf5677830006-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "cinder-quobyte-411058e0-7544-4d35-85cc-bf5677830006" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-411058e0-7544-4d35-85cc-bf5677830006" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e167ce09-3fb9-46c2-9421-5c17d6e14b59]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (617796da-579d-42f4-b637-aa7e84adf813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f32810-b152-4095-ad3f-45c183a9eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f32810-b152-4095-ad3f-45c183a9eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-315145552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beda6ef8-74a7-4079-9a52-9bc92dc09159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:25Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50459c0e-1f03-457e-b614-ffd7e3f76106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50459c0e-1f03-457e-b614-ffd7e3f76106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 Sep 28 15:11:25 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bde61d-03a7-4826-a340-1e2aa8895be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bde61d-03a7-4826-a340-1e2aa8895be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beda6ef8-74a7-4079-9a52-9bc92dc09159', 'volume_name': 'volume-beda6ef8-74a7-4079-9a52-9bc92dc09159', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0caf00-7677-476f-9440-65c8b9a46e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0caf00-7677-476f-9440-65c8b9a46e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8af216d-467e-4ae7-8fbb-1bb6139af4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Volume beda6ef8-74a7-4079-9a52-9bc92dc09159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beda6ef8-74a7-4079-9a52-9bc92dc09159', 'volume_size': 1} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-315145552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beda6ef8-74a7-4079-9a52-9bc92dc09159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:25Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Creating volume beda6ef8-74a7-4079-9a52-9bc92dc09159 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:25 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 1073741824 Sep 28 15:11:25 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006" returned: 0 in 0.463s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006 Sep 28 15:11:25 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-411058e0-7544-4d35-85cc-bf5677830006" returned: 0 in 0.330s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-quobyte-411058e0-7544-4d35-85cc-bf5677830006" released by "delete_volume" :: held 0.852s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:26 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 1073741824" returned: 0 in 0.649s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Created reservations ['5e9a1dd2-c25c-4b97-8869-c043791b2795', 'a7ad64ad-3b55-453a-8cf7-18dc22657cd2', 'a97a4eb2-9c28-4bf4-a872-bd2de9b1a2bf', '886569a6-a0e8-472c-8d90-091af592c4f0'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:26 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 Sep 28 15:11:26 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:26 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Flow 'volume_create_manager' (e1fb7084-8590-4f84-b35d-f249a2aac68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:26 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2596d8ef-b999-4788-9c43-198c4454f4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2596d8ef-b999-4788-9c43-198c4454f4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1242346654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad06e15-e69d-46ca-b653-fbb7d3d46fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782749754f094414b7471c08a96c3b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:26Z,use_quota=True,user_id='42262b7c4b9c4fd48e2888159148706a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff468474-fb51-4e3b-b051-a37b8de8b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff468474-fb51-4e3b-b051-a37b8de8b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e71800-677b-4226-95c5-ca78e60e29dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e71800-677b-4226-95c5-ca78e60e29dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad06e15-e69d-46ca-b653-fbb7d3d46fe5', 'volume_name': 'volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52050ba2-7659-4de5-9fdf-6a85de1f8053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52050ba2-7659-4de5-9fdf-6a85de1f8053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b3c661-71a6-469b-887c-62aa06370408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Volume dad06e15-e69d-46ca-b653-fbb7d3d46fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5', 'volume_size': 1} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1242346654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad06e15-e69d-46ca-b653-fbb7d3d46fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782749754f094414b7471c08a96c3b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:26Z,use_quota=True,user_id='42262b7c4b9c4fd48e2888159148706a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Creating volume dad06e15-e69d-46ca-b653-fbb7d3d46fe5 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:26 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8af216d-467e-4ae7-8fbb-1bb6139af4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beda6ef8-74a7-4079-9a52-9bc92dc09159', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335bcd91-748e-4014-912f-9bdaa6e3eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 1073741824 Sep 28 15:11:26 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Volume volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 (beda6ef8-74a7-4079-9a52-9bc92dc09159): created successfully Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335bcd91-748e-4014-912f-9bdaa6e3eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (617796da-579d-42f4-b637-aa7e84adf813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:26 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.404s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cf744d8b-b9a5-4639-b490-fdb39d25c489 tempest-VolumesActionsTest-26859753 None] Created volume successfully. Sep 28 15:11:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Deleted volume successfully. Sep 28 15:11:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ddc47c5-886e-4f54-8ebd-23a0eed5c5aa tempest-VolumesDeleteCascade-152553286 None] Lock "cinder-411058e0-7544-4d35-85cc-bf5677830006-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:27 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 1073741824" returned: 0 in 0.665s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 Sep 28 15:11:27 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:27 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" returned: 0 in 0.369s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b3c661-71a6-469b-887c-62aa06370408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be31bcc3-9b50-4bf1-9f75-c3ff02e04131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Volume volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 (dad06e15-e69d-46ca-b653-fbb7d3d46fe5): created successfully Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be31bcc3-9b50-4bf1-9f75-c3ff02e04131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Flow 'volume_create_manager' (e1fb7084-8590-4f84-b35d-f249a2aac68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-beda6ef8-74a7-4079-9a52-9bc92dc09159-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-363ea338-3a8f-4f15-87a4-4b0e443cb596 tempest-AttachVolumeTestJSON-915533788 None] Created volume successfully. Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-beda6ef8-74a7-4079-9a52-9bc92dc09159-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-quobyte-beda6ef8-74a7-4079-9a52-9bc92dc09159" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-beda6ef8-74a7-4079-9a52-9bc92dc09159" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f8781-0211-45ad-a1c7-38ec81929964]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 Sep 28 15:11:28 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159" returned: 0 in 0.764s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:28 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159 Sep 28 15:11:28 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf59122-74b2-4180-b25f-085c518de6c9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:29 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:11:29 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:29 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-beda6ef8-74a7-4079-9a52-9bc92dc09159" returned: 0 in 0.547s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-beda6ef8-74a7-4079-9a52-9bc92dc09159" released by "delete_volume" :: held 1.402s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Created reservations ['20eef46e-576b-4475-9cc3-ac4ac17534fd', '4ace7e6d-2870-491a-9684-34edeb9fba58', 'd4e9adc8-d642-42bd-b614-64363d9e5420', 'aeab5315-4b3b-489d-9ba3-1fa42029f091'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:29 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.704s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.742s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-22ca2da6-4fbb-4df6-a33c-20afd341d850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '052715a4-742c-4792-a3da-f2663320776a', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:29 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:29 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-0ca60516-8599-49b2-b36f-d5f3878d41c4 req-219cf7b2-f1d4-49d3-8d13-c1cee96b4d96 tempest-TestStampPattern-237515929 None] attachment_update completed successfully. Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fc1a40-fdbd-48f8-b005-99bcede85024]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:30 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.375s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Deleted volume successfully. Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a89ed845-120f-483d-a12c-2eb7208f8293 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-beda6ef8-74a7-4079-9a52-9bc92dc09159-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:30 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 Sep 28 15:11:30 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:30 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" returned: 0 in 0.624s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.664s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bc94687-2c3c-4afe-a1c5-680b04b85cb2', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:11:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-0a8bbd0e-759e-4844-be63-2807b7c16e10 req-4f50793c-c4fd-4c77-a190-387662fc0dc9 tempest-AttachVolumeTestJSON-915533788 None] attachment_update completed successfully. Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (a5488228-dbe4-4aae-8b78-4331c0d2e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7620771e-b740-452e-b5cc-ce0ecc1ec1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7620771e-b740-452e-b5cc-ce0ecc1ec1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1121741383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:31Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317ebb0e-bb65-42b7-8d92-405819591831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317ebb0e-bb65-42b7-8d92-405819591831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74419f02-6d64-4436-8730-0ff32e0378ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74419f02-6d64-4436-8730-0ff32e0378ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2', 'volume_name': 'volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6097bf28-f3a7-46fe-a39b-389ed0573a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6097bf28-f3a7-46fe-a39b-389ed0573a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d301af2d-17d1-499e-a48b-9674fa01b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Volume 08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2', 'volume_size': 1} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1121741383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:31Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Creating volume 08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:31 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:31 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 1073741824 Sep 28 15:11:31 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:32 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 1073741824" returned: 0 in 0.649s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:32 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 Sep 28 15:11:32 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:32 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d301af2d-17d1-499e-a48b-9674fa01b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb75ec-057e-4530-ab3e-505d324322cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Volume volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 (08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2): created successfully Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb75ec-057e-4530-ab3e-505d324322cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (a5488228-dbe4-4aae-8b78-4331c0d2e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0f0b98e0-a5e7-4ec6-a07c-d84c23d5a0ce tempest-VolumesActionsTest-26859753 None] Created volume successfully. Sep 28 15:11:32 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Flow 'volume_create_manager' (fd86bc9e-2278-47d9-beef-40196fbafaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3864c7-91dd-44c0-9e44-9f5bf8345131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3864c7-91dd-44c0-9e44-9f5bf8345131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1558986957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99200d65-adbf-4b6c-9ac4-436659812bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdcb98cca3874a179065c0ba958862ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:33Z,use_quota=True,user_id='0b6194fa1e1140b0b908b598e995ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9013b655-957a-4a38-b7d3-5cc8f246a3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9013b655-957a-4a38-b7d3-5cc8f246a3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c91674c-2862-4cf8-b802-8d798cc77112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c91674c-2862-4cf8-b802-8d798cc77112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99200d65-adbf-4b6c-9ac4-436659812bd1', 'volume_name': 'volume-99200d65-adbf-4b6c-9ac4-436659812bd1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2873ed-9765-47e4-9c43-d65b39917a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2873ed-9765-47e4-9c43-d65b39917a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b9079-1340-445f-9fb9-70b98527721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Volume 99200d65-adbf-4b6c-9ac4-436659812bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99200d65-adbf-4b6c-9ac4-436659812bd1', 'volume_size': 1} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1558986957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99200d65-adbf-4b6c-9ac4-436659812bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdcb98cca3874a179065c0ba958862ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:33Z,use_quota=True,user_id='0b6194fa1e1140b0b908b598e995ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Creating volume 99200d65-adbf-4b6c-9ac4-436659812bd1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:33 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:33 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 1073741824 Sep 28 15:11:33 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "cinder-quobyte-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2" acquired by "delete_volume" :: waited 0.039s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdf5983-d09f-498a-b6ec-cb747c7ea07f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 1073741824" returned: 0 in 0.890s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-79c481bf-d3d8-4580-84cd-c4d790512193 req-6149f450-fdc5-4cd3-b930-b833573c66c0 tempest-AttachVolumeTestJSON-915533788 None] Terminate volume connection completed successfully. Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-79c481bf-d3d8-4580-84cd-c4d790512193 req-6149f450-fdc5-4cd3-b930-b833573c66c0 tempest-AttachVolumeTestJSON-915533788 None] Deleting attachment 9c7095bf-a206-4672-951e-ebff62620e98. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 Sep 28 15:11:34 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 Sep 28 15:11:34 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2" returned: 0 in 0.573s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1" returned: 0 in 0.438s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b9079-1340-445f-9fb9-70b98527721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99200d65-adbf-4b6c-9ac4-436659812bd1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:34 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2 Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de84255f-4fb7-41ba-a7ad-6036f33f8621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:34 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Volume volume-99200d65-adbf-4b6c-9ac4-436659812bd1 (99200d65-adbf-4b6c-9ac4-436659812bd1): created successfully Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de84255f-4fb7-41ba-a7ad-6036f33f8621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Flow 'volume_create_manager' (fd86bc9e-2278-47d9-beef-40196fbafaa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-095faae7-20f2-4057-96a8-a41962e575c9 tempest-VolumesMetadataTest-611548666 None] Created volume successfully. Sep 28 15:11:34 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2" returned: 0 in 0.354s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-quobyte-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2" released by "delete_volume" :: held 1.000s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:34 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Created reservations ['b1a1cd00-3608-4aef-9308-1f6de8fb0ee7', '1e3dc867-8914-45ba-b6e2-a64089f7c59e', '4c813b25-cc76-4db1-9a7c-829d1d13d0a7', 'e65abb31-8f9b-4a51-b58f-1d7986cb4dc4'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:35 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:35 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:35 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.385s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Deleted volume successfully. Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6b6a2295-c596-4d6b-906f-7d6dd58f2499 tempest-VolumesActionsTest-1597564065 None] Lock "cinder-08dcbed1-e34e-4c0f-96fd-335fc4c0d6b2-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-f6214cc2-1a17-4491-bb91-0ef7b6cc3a74 req-7ea07780-58fe-4058-a976-616c4f060322 tempest-AttachVolumeTestJSON-915533788 None] Terminate volume connection completed successfully. Sep 28 15:11:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-f6214cc2-1a17-4491-bb91-0ef7b6cc3a74 req-7ea07780-58fe-4058-a976-616c4f060322 tempest-AttachVolumeTestJSON-915533788 None] Deleting attachment 2bc94687-2c3c-4afe-a1c5-680b04b85cb2. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Acquiring lock "cinder-99200d65-adbf-4b6c-9ac4-436659812bd1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Lock "cinder-99200d65-adbf-4b6c-9ac4-436659812bd1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Acquiring lock "cinder-quobyte-99200d65-adbf-4b6c-9ac4-436659812bd1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Lock "cinder-quobyte-99200d65-adbf-4b6c-9ac4-436659812bd1" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a55d447-d2b8-4634-b3bc-5fb18fbaf191]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (f673e9d9-d6c2-4504-be11-0cd5b6d868ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d82b195-a9d0-4520-9199-cf6b1fa95e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:37 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 Sep 28 15:11:37 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d82b195-a9d0-4520-9199-cf6b1fa95e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371341349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f98d12-3f10-4d91-a153-466253cc9689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:37Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2967533-567d-4eb4-8e8f-23e8e9116c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2967533-567d-4eb4-8e8f-23e8e9116c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dec3eca-638a-467c-b33d-278d9161ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dec3eca-638a-467c-b33d-278d9161ddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f98d12-3f10-4d91-a153-466253cc9689', 'volume_name': 'volume-b3f98d12-3f10-4d91-a153-466253cc9689', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7883376e-dfb9-4308-9f6a-db8b0cd7b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7883376e-dfb9-4308-9f6a-db8b0cd7b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78840e8-9581-4333-88e4-0b5a85dc9bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Volume b3f98d12-3f10-4d91-a153-466253cc9689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f98d12-3f10-4d91-a153-466253cc9689', 'volume_size': 1} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371341349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f98d12-3f10-4d91-a153-466253cc9689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20efeff4921c4c009b26165bbb07e78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:37Z,use_quota=True,user_id='d5a2d7e59e704b4a97a96f9233c04c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Creating volume b3f98d12-3f10-4d91-a153-466253cc9689 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:37 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 1073741824 Sep 28 15:11:37 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:37 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1" returned: 0 in 0.739s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1 Sep 28 15:11:37 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:38 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-99200d65-adbf-4b6c-9ac4-436659812bd1" returned: 0 in 0.510s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Lock "cinder-quobyte-99200d65-adbf-4b6c-9ac4-436659812bd1" released by "delete_volume" :: held 1.367s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:38 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 1073741824" returned: 0 in 0.963s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Created reservations ['4d7b9cd6-e7e6-4cb6-a9a6-1eced9fb7d77', '5be29b4a-1fc3-4487-b83a-2dff7e70a2b3', 'ddc01ec4-1fb3-435a-8211-8284ce33975a', '679ec50e-1e48-4e0f-ad87-30a23298e338'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:38 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 Sep 28 15:11:38 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:38 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:38 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:38 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:38 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-a617fe3f-c67e-43c0-a7f9-735f0c8ff9b4 req-508f2175-c56d-4654-af85-69bf9b7c22c9 tempest-TestStampPattern-237515929 None] Terminate volume connection completed successfully. Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-a617fe3f-c67e-43c0-a7f9-735f0c8ff9b4 req-508f2175-c56d-4654-af85-69bf9b7c22c9 tempest-TestStampPattern-237515929 None] Deleting attachment 052715a4-742c-4792-a3da-f2663320776a. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689" returned: 0 in 0.703s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78840e8-9581-4333-88e4-0b5a85dc9bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f98d12-3f10-4d91-a153-466253cc9689', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b859a7-1064-4eeb-997d-3b2ea9f31317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Volume volume-b3f98d12-3f10-4d91-a153-466253cc9689 (b3f98d12-3f10-4d91-a153-466253cc9689): created successfully Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b859a7-1064-4eeb-997d-3b2ea9f31317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Flow 'volume_create_manager' (f673e9d9-d6c2-4504-be11-0cd5b6d868ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f398daf8-2fe6-4b02-99e5-01696acf80f1 tempest-VolumesActionsTest-26859753 None] Created volume successfully. Sep 28 15:11:39 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.777s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Deleted volume successfully. Sep 28 15:11:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b68dab04-8ce6-401b-b1cc-6e19d918e492 tempest-VolumesMetadataTest-611548666 None] Lock "cinder-99200d65-adbf-4b6c-9ac4-436659812bd1-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Creating offline snapshot f5c81603-9c9e-4568-ac75-c51c89e28b38 of volume 22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[402ec0b0-c276-4dba-888d-2b08a8a59e52]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:40 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:11:40 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:40 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:40 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:40 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.677s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:40 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 1G Sep 28 15:11:40 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:41 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.494s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Acquiring lock "cinder-b3f98d12-3f10-4d91-a153-466253cc9689-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Lock "cinder-b3f98d12-3f10-4d91-a153-466253cc9689-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Acquiring lock "cinder-quobyte-b3f98d12-3f10-4d91-a153-466253cc9689" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Lock "cinder-quobyte-b3f98d12-3f10-4d91-a153-466253cc9689" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ca80fe-82f3-408c-846c-4a4c51720f83]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:41 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 1G" returned: 0 in 0.837s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:41 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 Sep 28 15:11:41 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:41 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 Sep 28 15:11:41 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38" returned: 0 in 0.443s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 is being set with open permissions: ugo+rw Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 Sep 28 15:11:42 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689" returned: 0 in 0.677s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689 Sep 28 15:11:42 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38" returned: 0 in 0.317s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info Sep 28 15:11:42 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b3f98d12-3f10-4d91-a153-466253cc9689" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Lock "cinder-quobyte-b3f98d12-3f10-4d91-a153-466253cc9689" released by "delete_volume" :: held 1.129s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Created reservations ['605b6f06-80e3-4797-bb41-097979ddbfd8', '31ab9c83-a67e-45a0-8315-28c0387dadab', 'f6148e70-753e-4776-a476-93ebbdf795db', '63061101-905b-48b8-bf8f-c30771447538'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:42 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:42 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info" returned: 0 in 0.429s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:42 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info is being set with open permissions: ugo+rw Sep 28 15:11:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info Sep 28 15:11:42 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:43 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:43 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Deleted volume successfully. Sep 28 15:11:43 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fd118d65-3f75-49e6-a4b7-d860a6043f9c tempest-VolumesActionsTest-26859753 None] Lock "cinder-b3f98d12-3f10-4d91-a153-466253cc9689-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.info" returned: 0 in 0.360s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.228s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f843ead5-991a-4483-8a54-6b2f5e7fee1f tempest-TestStampPattern-237515929 None] Create snapshot completed successfully Sep 28 15:11:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "cinder-dad06e15-e69d-46ca-b653-fbb7d3d46fe5-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-dad06e15-e69d-46ca-b653-fbb7d3d46fe5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "cinder-quobyte-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-quobyte-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bee720-2564-4b2d-b193-853af5e7ded1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:44 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 Sep 28 15:11:44 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:44 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" returned: 0 in 0.570s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:44 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5 Sep 28 15:11:44 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:45 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" returned: 0 in 0.381s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-quobyte-dad06e15-e69d-46ca-b653-fbb7d3d46fe5" released by "delete_volume" :: held 1.007s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Created reservations ['185facf8-4347-4971-9ade-ea8db5467254', '1e49181e-54c3-4a3d-90d4-561f1aa96fea', 'beabd085-e651-4c4b-b06b-4fdc254b330b', 'd9c3b7a6-8787-4edd-addd-8723841b45ce'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:45 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:45 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:45 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Deleted volume successfully. Sep 28 15:11:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-95f1cd9f-d6f8-47e3-afb0-34a28f5cd1aa tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-dad06e15-e69d-46ca-b653-fbb7d3d46fe5-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "cinder-9552b253-81d9-4c02-b3d6-0ed70ace1b08-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-9552b253-81d9-4c02-b3d6-0ed70ace1b08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "cinder-quobyte-9552b253-81d9-4c02-b3d6-0ed70ace1b08" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-quobyte-9552b253-81d9-4c02-b3d6-0ed70ace1b08" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:46 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[87377daa-9168-4f8a-b5ba-c61ba37970c8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:46 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 Sep 28 15:11:46 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:47 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08" returned: 0 in 0.549s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:47 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08 Sep 28 15:11:47 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:47 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9552b253-81d9-4c02-b3d6-0ed70ace1b08" returned: 0 in 0.314s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-quobyte-9552b253-81d9-4c02-b3d6-0ed70ace1b08" released by "delete_volume" :: held 0.942s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Created reservations ['2e7740c4-87e2-4684-9e12-e8888534776e', '7bc0e11a-2094-4f8a-9ea6-d52697241794', '75aca7ea-782e-4fb8-b0f2-e5771facc080', '95af3272-4245-4ee4-92ed-7225ea444c1d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:47 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:47 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:48 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.512s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Deleted volume successfully. Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4710668-7fa3-4a3c-9004-4e56c11e5a34 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-9552b253-81d9-4c02-b3d6-0ed70ace1b08-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Flow 'volume_create_manager' (4513e33f-bc8c-4b63-850b-e58efed821cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74420d1-2dd8-4811-bb20-21fe8faa90bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74420d1-2dd8-4811-bb20-21fe8faa90bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-693210994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d08b1f-4133-48bc-85f6-25d2c817c9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5059005b82974bc8be5e42716dd42bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:49Z,use_quota=True,user_id='0e704c74884647ba9e5b1a3d663dbbdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2166c08-13e8-4915-b67c-7cd7a77370fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2166c08-13e8-4915-b67c-7cd7a77370fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9f6333-4d15-4dd2-a614-253befa64ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9f6333-4d15-4dd2-a614-253befa64ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d08b1f-4133-48bc-85f6-25d2c817c9de', 'volume_name': 'volume-72d08b1f-4133-48bc-85f6-25d2c817c9de', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd9a2c-5bab-4f62-9418-7b2981dd0bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd9a2c-5bab-4f62-9418-7b2981dd0bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f49124-e229-4091-ba40-d2222f2ccd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Volume 72d08b1f-4133-48bc-85f6-25d2c817c9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d08b1f-4133-48bc-85f6-25d2c817c9de', 'volume_size': 1} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-693210994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d08b1f-4133-48bc-85f6-25d2c817c9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5059005b82974bc8be5e42716dd42bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:49Z,use_quota=True,user_id='0e704c74884647ba9e5b1a3d663dbbdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Creating volume 72d08b1f-4133-48bc-85f6-25d2c817c9de {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:48 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:11:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "cinder-336a9857-cdf3-4207-85fc-6116a6ce2c6a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-336a9857-cdf3-4207-85fc-6116a6ce2c6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:49 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de 1073741824 Sep 28 15:11:49 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "cinder-quobyte-336a9857-cdf3-4207-85fc-6116a6ce2c6a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-quobyte-336a9857-cdf3-4207-85fc-6116a6ce2c6a" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d77b7c-9e5f-4c32-8966-61d91428ae74]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:49 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a Sep 28 15:11:49 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:49 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a" returned: 0 in 0.653s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:49 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a Sep 28 15:11:49 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:49 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de 1073741824" returned: 0 in 0.901s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:49 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de Sep 28 15:11:49 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:50 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-336a9857-cdf3-4207-85fc-6116a6ce2c6a" returned: 0 in 0.443s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-quobyte-336a9857-cdf3-4207-85fc-6116a6ce2c6a" released by "delete_volume" :: held 1.179s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Created reservations ['3fc7460e-fcd7-4032-ab6c-e70da6f34990', '287f161f-180a-454a-8e8c-73910bb192ce', 'cb1fd22c-1d35-42bc-aa81-9542071c972b', 'e241ee0f-cef3-4ce9-80e4-1c2368bff593'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:50 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de" returned: 0 in 0.535s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:50 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:50 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f49124-e229-4091-ba40-d2222f2ccd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d08b1f-4133-48bc-85f6-25d2c817c9de', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e9ed96-9622-4a87-a26a-f5bdd13eacf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:50 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Volume volume-72d08b1f-4133-48bc-85f6-25d2c817c9de (72d08b1f-4133-48bc-85f6-25d2c817c9de): created successfully Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e9ed96-9622-4a87-a26a-f5bdd13eacf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Flow 'volume_create_manager' (4513e33f-bc8c-4b63-850b-e58efed821cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:50 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-722381f0-d016-4469-ac1e-f87aa168c29f tempest-VolumesTransfersV355Test-861215774 None] Created volume successfully. Sep 28 15:11:50 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.410s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:50 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Deleted volume successfully. Sep 28 15:11:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-934c3e79-9581-4973-a495-c430550b50e9 tempest-AttachVolumeTestJSON-915533788 None] Lock "cinder-336a9857-cdf3-4207-85fc-6116a6ce2c6a-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6ab0610b-d07c-49f6-b500-e85be5c882ff tempest-VolumesTransfersV355Test-2009875434 None] Transfer volume completed successfully. Sep 28 15:11:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Acquiring lock "cinder-72d08b1f-4133-48bc-85f6-25d2c817c9de-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-72d08b1f-4133-48bc-85f6-25d2c817c9de-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Acquiring lock "cinder-quobyte-72d08b1f-4133-48bc-85f6-25d2c817c9de" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-quobyte-72d08b1f-4133-48bc-85f6-25d2c817c9de" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec9818-a73f-48c9-9973-d07fe07baede]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:53 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de Sep 28 15:11:53 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:54 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de" returned: 0 in 0.701s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:54 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de Sep 28 15:11:54 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:54 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-72d08b1f-4133-48bc-85f6-25d2c817c9de" returned: 0 in 0.398s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-quobyte-72d08b1f-4133-48bc-85f6-25d2c817c9de" released by "delete_volume" :: held 1.185s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Created reservations ['3caf98fb-7ec6-4ca6-b535-7ff8c1129f5a', '2958869e-86bf-4f4d-acaf-80d2349376bd', '75326ccc-edd5-41b6-a1d1-f9df8b5c640f', 'b4824411-8456-4dae-8728-b67d13fcf89b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:54 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:11:54 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:55 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.320s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Deleted volume successfully. Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0e37b2e2-a0da-4d38-8c38-69ba0cc60b0b tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-72d08b1f-4133-48bc-85f6-25d2c817c9de-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Flow 'volume_create_manager' (3b532463-5a98-401e-9855-3f99103fa4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0cd42d-14f8-4b2f-856e-f237f6ca7d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0cd42d-14f8-4b2f-856e-f237f6ca7d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-779915390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86f15c-5b78-4fb3-8335-278ca986db41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fab8c5a87a2411491404788048974da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5c81603-9c9e-4568-ac75-c51c89e28b38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:55Z,use_quota=True,user_id='3ddf40e453a645b6beb5b2fc02836681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61055f3f-5c89-42ee-92c0-b4375f7b410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61055f3f-5c89-42ee-92c0-b4375f7b410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373cca26-7a05-4662-89c3-d8f855ac5573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373cca26-7a05-4662-89c3-d8f855ac5573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb86f15c-5b78-4fb3-8335-278ca986db41', 'volume_name': 'volume-bb86f15c-5b78-4fb3-8335-278ca986db41', 'volume_size': 1, 'snapshot_id': 'f5c81603-9c9e-4568-ac75-c51c89e28b38'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9f64da-494c-4d05-b99f-5f763f8b7138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9f64da-494c-4d05-b99f-5f763f8b7138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bddc2e-f4d4-4ef8-a6b8-f8ab0b24baa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:55 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Volume bb86f15c-5b78-4fb3-8335-278ca986db41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb86f15c-5b78-4fb3-8335-278ca986db41', 'volume_size': 1, 'snapshot_id': 'f5c81603-9c9e-4568-ac75-c51c89e28b38'} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-quobyte-f5c81603-9c9e-4568-ac75-c51c89e28b38-bb86f15c-5b78-4fb3-8335-278ca986db41" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-f5c81603-9c9e-4568-ac75-c51c89e28b38-bb86f15c-5b78-4fb3-8335-278ca986db41" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Creating volume bb86f15c-5b78-4fb3-8335-278ca986db41 from snapshot f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-quobyte-bb86f15c-5b78-4fb3-8335-278ca986db41" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-bb86f15c-5b78-4fb3-8335-278ca986db41" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] snapshot: f5c81603-9c9e-4568-ac75-c51c89e28b38, volume: bb86f15c-5b78-4fb3-8335-278ca986db41, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecdcbc3-0405-4081-a5a9-759808f590e2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:55 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 Sep 28 15:11:55 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:56 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ca2da6-4fbb-4df6-a33c-20afd341d850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aecad2e-0545-42c8-acad-e531e227ae81]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Flow 'volume_create_manager' (f819826e-e24e-405b-9a40-a6c843b862db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bff41cf-aaad-4e69-8dd1-1b2056ac1a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bff41cf-aaad-4e69-8dd1-1b2056ac1a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1341618784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ffd26f-8a53-416a-8e28-0f12e85cd9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5059005b82974bc8be5e42716dd42bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:56Z,use_quota=True,user_id='0e704c74884647ba9e5b1a3d663dbbdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58402e91-c9f8-4c51-866c-1c017cc964e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58402e91-c9f8-4c51-866c-1c017cc964e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1d97e6-b311-4cff-b655-183c8827df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1d97e6-b311-4cff-b655-183c8827df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ffd26f-8a53-416a-8e28-0f12e85cd9ff', 'volume_name': 'volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ea022e-6084-414d-8db6-a6937777a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ea022e-6084-414d-8db6-a6937777a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf53188c-5306-43d4-92a5-eda6645f726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Volume 76ffd26f-8a53-416a-8e28-0f12e85cd9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff', 'volume_size': 1} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:56 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:11:56 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:56 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:11:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:56 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 Sep 28 15:11:56 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=110,cinder:UPDATE=148,cinder:INSERT=30,cinder:DELETE=13 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=121,cinder:UPDATE=129,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:08 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41" returned: 0 in 11.601s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b1d11-c06b-4a70-bf79-5d2a3f133acf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:08 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:12:08 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 1.181s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850, size 1024.00 MB, duration 11.60 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:12:09 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Converted 1024.00 MB image at 88.24 MB/s Sep 28 15:12:09 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 is being set with open permissions: ugo+rw Sep 28 15:12:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 Sep 28 15:12:09 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:10 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41" returned: 0 in 0.488s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-bb86f15c-5b78-4fb3-8335-278ca986db41" released by "_copy_volume_from_snapshot" :: held 14.449s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-f5c81603-9c9e-4568-ac75-c51c89e28b38-bb86f15c-5b78-4fb3-8335-278ca986db41" released by "_create_volume_from_snapshot" :: held 14.497s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.529s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.804s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1341618784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ffd26f-8a53-416a-8e28-0f12e85cd9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5059005b82974bc8be5e42716dd42bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:56Z,use_quota=True,user_id='0e704c74884647ba9e5b1a3d663dbbdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Creating volume 76ffd26f-8a53-416a-8e28-0f12e85cd9ff {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:10 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:10 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff 1073741824 Sep 28 15:12:10 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bddc2e-f4d4-4ef8-a6b8-f8ab0b24baa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb86f15c-5b78-4fb3-8335-278ca986db41', 'volume_size': 1, 'snapshot_id': 'f5c81603-9c9e-4568-ac75-c51c89e28b38'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443fe04d-6dd8-4412-b63d-a4d84de8646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Volume volume-bb86f15c-5b78-4fb3-8335-278ca986db41 (bb86f15c-5b78-4fb3-8335-278ca986db41): created successfully Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443fe04d-6dd8-4412-b63d-a4d84de8646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Flow 'volume_create_manager' (3b532463-5a98-401e-9855-3f99103fa4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-36d00816-940a-4fa6-b3d2-608339cbf528 tempest-TestStampPattern-237515929 None] Created volume successfully. Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Flow 'volume_create_manager' (f08e7d62-39a5-4131-b53d-c2bc8dca35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3d2af7-590b-41b7-9554-a0e2046fefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3d2af7-590b-41b7-9554-a0e2046fefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1716606445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c84d873-9ae2-430c-b772-f219e3f342f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ce992506741988f34e91bcbdbd667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:10Z,use_quota=True,user_id='e73fc729f8114ee28108ac161979ddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2288d774-fb94-4256-91f0-fd5705ce1084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2288d774-fb94-4256-91f0-fd5705ce1084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55807a5b-c553-448e-a96f-0b29d4c85c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55807a5b-c553-448e-a96f-0b29d4c85c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c84d873-9ae2-430c-b772-f219e3f342f5', 'volume_name': 'volume-7c84d873-9ae2-430c-b772-f219e3f342f5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1920a1-fa8c-405c-b654-8361a05fc75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1920a1-fa8c-405c-b654-8361a05fc75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb471fe-4175-4b9b-aee6-f839ccdbcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Volume 7c84d873-9ae2-430c-b772-f219e3f342f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c84d873-9ae2-430c-b772-f219e3f342f5', 'volume_size': 1} Sep 28 15:12:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:11 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff 1073741824" returned: 0 in 1.089s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:11 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff Sep 28 15:12:11 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:11 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff" returned: 0 in 0.507s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1716606445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c84d873-9ae2-430c-b772-f219e3f342f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ce992506741988f34e91bcbdbd667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:10Z,use_quota=True,user_id='e73fc729f8114ee28108ac161979ddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Creating volume 7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:11 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:11 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 1073741824 Sep 28 15:12:11 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf53188c-5306-43d4-92a5-eda6645f726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0910b3fd-04e9-468d-8cc7-8d3f7985ffb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Volume volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff (76ffd26f-8a53-416a-8e28-0f12e85cd9ff): created successfully Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0910b3fd-04e9-468d-8cc7-8d3f7985ffb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Flow 'volume_create_manager' (f819826e-e24e-405b-9a40-a6c843b862db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8fa02132-e1ba-4540-bd20-a07b28da589d tempest-VolumesTransfersV355Test-861215774 None] Created volume successfully. Sep 28 15:12:12 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 1073741824" returned: 0 in 0.720s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:12 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 Sep 28 15:12:12 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:13 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb471fe-4175-4b9b-aee6-f839ccdbcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c84d873-9ae2-430c-b772-f219e3f342f5', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979b21ce-e894-45ff-820b-27f2c28f3f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:13 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Volume volume-7c84d873-9ae2-430c-b772-f219e3f342f5 (7c84d873-9ae2-430c-b772-f219e3f342f5): created successfully Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979b21ce-e894-45ff-820b-27f2c28f3f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Flow 'volume_create_manager' (f08e7d62-39a5-4131-b53d-c2bc8dca35a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-e1fca866-4310-4e47-8b76-889452d21dd1 req-aa1289c9-7df6-4e47-b891-077727d3e187 tempest-VolumesSnapshotsTestJSON-2055265995 None] Created volume successfully. Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Acquiring lock "cinder-76ffd26f-8a53-416a-8e28-0f12e85cd9ff-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-76ffd26f-8a53-416a-8e28-0f12e85cd9ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Acquiring lock "cinder-quobyte-76ffd26f-8a53-416a-8e28-0f12e85cd9ff" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-quobyte-76ffd26f-8a53-416a-8e28-0f12e85cd9ff" acquired by "delete_volume" :: waited 0.047s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b362d11-9c8f-4729-a0a0-6dc78f9dfaaf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:14 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff Sep 28 15:12:14 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Creating offline snapshot 5954cf3e-e127-4306-9c6d-b976f9ce6128 of volume 7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:14 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90cc545-506b-467f-8a61-3e7077d23613]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 Sep 28 15:12:15 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff" returned: 0 in 1.183s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff Sep 28 15:12:15 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5" returned: 0 in 0.890s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 1G Sep 28 15:12:15 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:15 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-76ffd26f-8a53-416a-8e28-0f12e85cd9ff" returned: 0 in 0.552s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-quobyte-76ffd26f-8a53-416a-8e28-0f12e85cd9ff" released by "delete_volume" :: held 1.888s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Created reservations ['5fb48860-5d1a-4bfe-a355-a61ee047bed6', '79725a2f-fa2d-4c83-b3fe-a51fcd483440', 'd20fa1b8-1598-4026-a9f8-4046d6c077f8', 'de2e1768-d978-45f8-9846-a41355f2fb50'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:15 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:15 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 1G" returned: 0 in 0.767s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c84d873-9ae2-430c-b772-f219e3f342f5 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.432s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Deleted volume successfully. Sep 28 15:12:16 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c84d873-9ae2-430c-b772-f219e3f342f5 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 Sep 28 15:12:16 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6e3893-b654-4278-ab3f-7e888780268f tempest-VolumesTransfersV355Test-1656622104 None] Lock "cinder-76ffd26f-8a53-416a-8e28-0f12e85cd9ff-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:16 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c84d873-9ae2-430c-b772-f219e3f342f5 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128" returned: 0 in 0.534s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 is being set with open permissions: ugo+rw Sep 28 15:12:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 Sep 28 15:12:16 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128" returned: 0 in 0.484s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:17 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info Sep 28 15:12:17 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info" returned: 0 in 0.584s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info is being set with open permissions: ugo+rw Sep 28 15:12:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:18 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info Sep 28 15:12:18 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:18 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.info" returned: 0 in 0.634s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.106s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:18 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-bdf5d740-bdcc-4dd8-b2f9-486cdafec53e req-1ee2c2b7-c826-4869-8878-a53f355e54f7 tempest-VolumesSnapshotsTestJSON-2055265995 None] Create snapshot completed successfully Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "cinder-5954cf3e-e127-4306-9c6d-b976f9ce6128-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-5954cf3e-e127-4306-9c6d-b976f9ce6128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "cinder-quobyte-7c84d873-9ae2-430c-b772-f219e3f342f5" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-quobyte-7c84d873-9ae2-430c-b772-f219e3f342f5" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "cinder-quobyte-5954cf3e-e127-4306-9c6d-b976f9ce6128" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-quobyte-5954cf3e-e127-4306-9c6d-b976f9ce6128" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Deleting offline snapshot 5954cf3e-e127-4306-9c6d-b976f9ce6128 of volume 7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] snapshot_file for this snap is: volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a26dd3b-bba5-44b7-b162-7c41b928e7c0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:19 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 Sep 28 15:12:19 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:20 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128" returned: 0 in 1.053s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c84d873-9ae2-430c-b772-f219e3f342f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b846f6d-fc5e-4484-8ade-27754a166cc3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:20 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 Sep 28 15:12:20 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:21 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5" returned: 0 in 0.509s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 Sep 28 15:12:21 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:21 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128" returned: 0 in 0.569s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128 Sep 28 15:12:21 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5.5954cf3e-e127-4306-9c6d-b976f9ce6128" returned: 0 in 0.443s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-quobyte-5954cf3e-e127-4306-9c6d-b976f9ce6128" released by "_delete_snapshot" :: held 2.842s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-quobyte-7c84d873-9ae2-430c-b772-f219e3f342f5" released by "delete_snapshot" :: held 2.910s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[86888]: DEBUG cinder.quota [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Created reservations ['48d6aded-2fa3-4601-adee-79936340b60e', 'ddebff24-0e2f-4dab-80f8-0f5e2358d6a4', '7e7bf9d4-55f4-4181-8a9f-e001fabb5123', 'd9ca5664-a036-4d29-9bb9-2ef301114798'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Delete snapshot completed successfully. Sep 28 15:12:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-257c6374-382e-4eb2-8629-ba9c0155ed9f req-503af6e9-bd73-466d-8105-8bd82b9f5137 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-5954cf3e-e127-4306-9c6d-b976f9ce6128-delete_snapshot" released by "delete_snapshot" :: held 3.226s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "cinder-7c84d873-9ae2-430c-b772-f219e3f342f5-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-7c84d873-9ae2-430c-b772-f219e3f342f5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "cinder-quobyte-7c84d873-9ae2-430c-b772-f219e3f342f5" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-quobyte-7c84d873-9ae2-430c-b772-f219e3f342f5" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:23 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9cd4af-a600-474d-9ae8-d367cec5e2b2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:23 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 Sep 28 15:12:23 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:24 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5" returned: 0 in 0.860s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:24 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5 Sep 28 15:12:24 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:24 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7c84d873-9ae2-430c-b772-f219e3f342f5" returned: 0 in 0.416s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-quobyte-7c84d873-9ae2-430c-b772-f219e3f342f5" released by "delete_volume" :: held 1.435s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG cinder.quota [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Created reservations ['2a666fbd-edb6-4a5e-a623-a222ae3b65ed', 'b44ad06b-1be1-48a9-8568-0df00c76952b', '4500ece6-8c00-41c6-bd53-93f7f747b307', 'b7206dbc-fcb1-40c3-9a78-8a115e181ed9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:25 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:25 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:25 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.697s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:25 devstack cinder-volume[86888]: DEBUG cinder.manager [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:25 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Deleted volume successfully. Sep 28 15:12:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-d5410ebe-af3e-4102-9d94-0941d59e48b3 req-9ca846af-9002-473d-b840-08aa7b2e1509 tempest-VolumesSnapshotsTestJSON-2055265995 None] Lock "cinder-7c84d873-9ae2-430c-b772-f219e3f342f5-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Flow 'volume_create_manager' (de6aea0d-d37f-49f5-88e1-f10082aacc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb0db16-0106-403e-99c8-498957f70c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb0db16-0106-403e-99c8-498957f70c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-979420763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa810bbc-22a9-408c-a246-edfa61fab7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611266aa88db461bb0237d8f5ef2ae6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:29Z,use_quota=True,user_id='1af5d6e2971d42b9bffa3339f4619512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f44826e-9301-4afc-998d-8c8ad57cd280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f44826e-9301-4afc-998d-8c8ad57cd280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458942da-e8f1-41f9-ac4c-5182ee45f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:28 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:12:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458942da-e8f1-41f9-ac4c-5182ee45f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa810bbc-22a9-408c-a246-edfa61fab7d8', 'volume_name': 'volume-fa810bbc-22a9-408c-a246-edfa61fab7d8', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f9e6da-dc53-4481-a735-ed4b4eb05446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f9e6da-dc53-4481-a735-ed4b4eb05446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd5c2ca-5422-4c4d-8ed7-59adb05cd5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:29 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Volume fa810bbc-22a9-408c-a246-edfa61fab7d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa810bbc-22a9-408c-a246-edfa61fab7d8', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:12:29 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Trying to clone fa810bbc-22a9-408c-a246-edfa61fab7d8 from image 014259cc-3d70-4b12-abe4-95d560fe7bff at location (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:12:30 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:12:30 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:12:30 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[67487147-20f8-4168-9699-64952470fa6a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:30 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD Sep 28 15:12:30 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:30 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:30 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff is fetched for user 1af5d6e2971d42b9bffa3339f4619512. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaa4a0d-8857-4ad6-981e-a826e4edb823]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:31 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD Sep 28 15:12:31 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Flow 'volume_create_manager' (8819ee0a-5dd2-4955-8059-1a733024cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b01a2c-0509-4e6d-b9f6-79559cf3b584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b01a2c-0509-4e6d-b9f6-79559cf3b584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-542578970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2823bb67-d4b2-4211-b528-db7748602c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a700d18b24a8181643b6bdaa135ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:31Z,use_quota=True,user_id='e6c4a2e3d52141f7ab151f2745db1de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace5e1b7-709d-4714-aeea-77b7fa798467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace5e1b7-709d-4714-aeea-77b7fa798467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f829ce9-ff8e-4fb4-b919-1f2de67b326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f829ce9-ff8e-4fb4-b919-1f2de67b326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2823bb67-d4b2-4211-b528-db7748602c52', 'volume_name': 'volume-2823bb67-d4b2-4211-b528-db7748602c52', 'volume_size': 2}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7756a76-e034-4007-b0b4-e756af3b785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7756a76-e034-4007-b0b4-e756af3b785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f835528-2b00-4f10-95a9-534f5aee66a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Volume 2823bb67-d4b2-4211-b528-db7748602c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2823bb67-d4b2-4211-b528-db7748602c52', 'volume_size': 2} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-542578970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2823bb67-d4b2-4211-b528-db7748602c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043a700d18b24a8181643b6bdaa135ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:31Z,use_quota=True,user_id='e6c4a2e3d52141f7ab151f2745db1de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Creating volume 2823bb67-d4b2-4211-b528-db7748602c52 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:31 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 2147483648 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:31 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:31 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 2147483648 Sep 28 15:12:31 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:32 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 2147483648" returned: 0 in 0.652s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:32 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 Sep 28 15:12:32 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:32 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52" returned: 0 in 0.339s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-979420763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa810bbc-22a9-408c-a246-edfa61fab7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611266aa88db461bb0237d8f5ef2ae6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:29Z,use_quota=True,user_id='1af5d6e2971d42b9bffa3339f4619512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Creating volume fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:32 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f835528-2b00-4f10-95a9-534f5aee66a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2823bb67-d4b2-4211-b528-db7748602c52', 'volume_size': 2}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:32 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 1073741824 Sep 28 15:12:32 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18345521-0fbe-4eb4-8c49-e912deb81733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Volume volume-2823bb67-d4b2-4211-b528-db7748602c52 (2823bb67-d4b2-4211-b528-db7748602c52): created successfully Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18345521-0fbe-4eb4-8c49-e912deb81733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Flow 'volume_create_manager' (8819ee0a-5dd2-4955-8059-1a733024cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-678d4f47-6ee0-4af2-a954-282d31213e03 tempest-VolumesCloneNegativeTest-350366454 None] Created volume successfully. Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Flow 'volume_create_manager' (71affe13-af42-4d48-9d61-0a8d3561adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859e900b-3181-4398-b0dd-b55bd402d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859e900b-3181-4398-b0dd-b55bd402d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2056657334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6ff68d-5cee-4f86-89cd-088f4f7a98ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='933fd20fd1a34c1293b55e46d1344503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:33Z,use_quota=True,user_id='38ad91003bd7447d804bfbbb3d919850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3a2b01-6de5-4dbc-a7f0-dc38a156c9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3a2b01-6de5-4dbc-a7f0-dc38a156c9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577677d6-8ac1-4554-8b40-cab77450d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577677d6-8ac1-4554-8b40-cab77450d85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b6ff68d-5cee-4f86-89cd-088f4f7a98ef', 'volume_name': 'volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6f090-6aef-40aa-9476-ed0d4abf5145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6f090-6aef-40aa-9476-ed0d4abf5145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342d638b-cfe3-490d-a573-49e7e00f5f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Volume 1b6ff68d-5cee-4f86-89cd-088f4f7a98ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef', 'volume_size': 1} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:33 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 1073741824" returned: 0 in 0.606s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:33 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:33 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:33 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 0 in 0.285s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2056657334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6ff68d-5cee-4f86-89cd-088f4f7a98ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='933fd20fd1a34c1293b55e46d1344503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:33Z,use_quota=True,user_id='38ad91003bd7447d804bfbbb3d919850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Creating volume 1b6ff68d-5cee-4f86-89cd-088f4f7a98ef {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:33 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Acquiring lock "cinder-2823bb67-d4b2-4211-b528-db7748602c52-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:33 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef 1073741824 Sep 28 15:12:33 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Lock "cinder-2823bb67-d4b2-4211-b528-db7748602c52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Attempting download of 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume fa810bbc-22a9-408c-a246-edfa61fab7d8. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Acquiring lock "cinder-quobyte-2823bb67-d4b2-4211-b528-db7748602c52" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Lock "cinder-quobyte-2823bb67-d4b2-4211-b528-db7748602c52" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b5e9a4-39b9-488c-ae65-2698a8a0050e]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c155f-77cd-4112-89c5-b6f31f332b6b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5 Sep 28 15:12:34 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 Sep 28 15:12:34 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5" returned: 0 in 0.458s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef 1073741824" returned: 0 in 0.681s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef Sep 28 15:12:34 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52" returned: 0 in 0.578s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5 Sep 28 15:12:34 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52 Sep 28 15:12:34 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5" returned: 1 in 0.421s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_9zijfnr5' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ce102-ad8c-4cfc-8257-af02aec37e48]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:34 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef" returned: 0 in 0.397s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342d638b-cfe3-490d-a573-49e7e00f5f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5b4bdb-73bd-47e1-8dcc-bbf258503399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Volume volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef (1b6ff68d-5cee-4f86-89cd-088f4f7a98ef): created successfully Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5b4bdb-73bd-47e1-8dcc-bbf258503399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Flow 'volume_create_manager' (71affe13-af42-4d48-9d61-0a8d3561adfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-bdafc593-bebb-4a3b-b671-c71ff529cba3 req-b3470684-f187-4781-a973-d4410b133ff4 tempest-VolumesGetTestJSON-987429183 None] Created volume successfully. Sep 28 15:12:34 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD Sep 28 15:12:34 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:34 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2823bb67-d4b2-4211-b528-db7748602c52" returned: 0 in 0.436s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Lock "cinder-quobyte-2823bb67-d4b2-4211-b528-db7748602c52" released by "delete_volume" :: held 1.099s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:34 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Created reservations ['c7f1af9e-7594-4b3e-96f0-df3001783c6d', 'a67d1f4f-7190-4e5e-91a2-0d015a7e2620', 'f46c7a38-fe31-4b60-b1df-9a9c47de1448', 'fbbafc8f-da45-4c13-a5e3-49a30ee60688'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:35 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:35 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:35 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] 014259cc-3d70-4b12-abe4-95d560fe7bff was qcow2, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:35 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:35 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:35 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Deleted volume successfully. Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Acquiring lock "cinder-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-cf2c2f3c-6144-48e9-b4e3-4b5277a6efcd tempest-VolumesCloneNegativeTest-350366454 None] Lock "cinder-2823bb67-d4b2-4211-b528-db7748602c52-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Lock "cinder-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Acquiring lock "cinder-quobyte-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Lock "cinder-quobyte-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da5d97-fd79-473f-a38e-7559c468f96e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:35 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef Sep 28 15:12:35 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:36 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef" returned: 0 in 0.565s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:36 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef Sep 28 15:12:36 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:36 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef" returned: 0 in 0.407s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Lock "cinder-quobyte-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef" released by "delete_volume" :: held 1.043s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG cinder.quota [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Created reservations ['10010369-c196-416d-ad21-0a30c890a983', 'dc7eff26-9bb2-47df-a9af-23fc469d5f60', 'd6a5f875-93d2-4f14-a6a7-0ab10cb55bae', 'e853aced-ad6d-4036-bd8e-cf96db785f26'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:36 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:36 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:37 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG cinder.manager [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Deleted volume successfully. Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-2f4e4e1a-8dbe-484d-9a34-865d2eb468e1 req-cee225ca-be41-4db3-9b51-fe48f1850cb1 tempest-VolumesGetTestJSON-987429183 None] Lock "cinder-1b6ff68d-5cee-4f86-89cd-088f4f7a98ef-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:37 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 0 in 2.273s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_in9h61fzdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:12:37 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Converted 112.00 MB image at 49.21 MB/s Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:37 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 1G Sep 28 15:12:37 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:37 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 1G" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576f0f5-50de-4cc5-8a59-3d872c5b5ecb]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:38 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:38 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:38 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 0 in 0.579s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:38 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:38 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:39 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 1 in 0.514s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Downloaded image 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume fa810bbc-22a9-408c-a246-edfa61fab7d8 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff for user 1af5d6e2971d42b9bffa3339f4619512 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Marking volume fa810bbc-22a9-408c-a246-edfa61fab7d8 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Copying metadata from image 014259cc-3d70-4b12-abe4-95d560fe7bff to fa810bbc-22a9-408c-a246-edfa61fab7d8. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Creating volume glance metadata for volume fa810bbc-22a9-408c-a246-edfa61fab7d8 backed by image 014259cc-3d70-4b12-abe4-95d560fe7bff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd5c2ca-5422-4c4d-8ed7-59adb05cd5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa810bbc-22a9-408c-a246-edfa61fab7d8', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99c7896-b83a-4542-8c96-45bee9947d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Volume volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 (fa810bbc-22a9-408c-a246-edfa61fab7d8): created successfully Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99c7896-b83a-4542-8c96-45bee9947d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Flow 'volume_create_manager' (de6aea0d-d37f-49f5-88e1-f10082aacc69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-55598265-6cac-4c42-897f-44aa5b895392 tempest-VolumesImageMetadata-382069853 None] Created volume successfully. Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Acquiring lock "cinder-fa810bbc-22a9-408c-a246-edfa61fab7d8-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Lock "cinder-fa810bbc-22a9-408c-a246-edfa61fab7d8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Acquiring lock "cinder-quobyte-fa810bbc-22a9-408c-a246-edfa61fab7d8" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Lock "cinder-quobyte-fa810bbc-22a9-408c-a246-edfa61fab7d8" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f971faba-4f1f-42aa-b420-51e3b4fbc123]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:12:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:12:40 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:40 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 0 in 0.473s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:41 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:41 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 1 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:41 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8 Sep 28 15:12:41 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:41 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fa810bbc-22a9-408c-a246-edfa61fab7d8" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Lock "cinder-quobyte-fa810bbc-22a9-408c-a246-edfa61fab7d8" released by "delete_volume" :: held 1.483s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Flow 'volume_create_manager' (7bf5e02a-d9ab-4f49-bb89-f4bb71fba3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decd3972-c900-4f1c-a67b-dd5f1dfa5d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decd3972-c900-4f1c-a67b-dd5f1dfa5d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-165446625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac972b5d-23b6-4ca3-9cbc-f717d7c805fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b76fe3dce69947fe9ed64cc4e2b3bf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:42Z,use_quota=True,user_id='46bae4f567474b61bbb708f4537dfe43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fb3c57-0868-4bd1-9754-14a08a666097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fb3c57-0868-4bd1-9754-14a08a666097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d77c30-b5b1-4374-a86a-b487a7e62e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d77c30-b5b1-4374-a86a-b487a7e62e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac972b5d-23b6-4ca3-9cbc-f717d7c805fb', 'volume_name': 'volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bf9870-6d5b-4c45-8535-5bd1173ae81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bf9870-6d5b-4c45-8535-5bd1173ae81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a062927-0a09-427b-96bf-49c3ecd134de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:42 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Volume ac972b5d-23b6-4ca3-9cbc-f717d7c805fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb', 'volume_size': 1} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-165446625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac972b5d-23b6-4ca3-9cbc-f717d7c805fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b76fe3dce69947fe9ed64cc4e2b3bf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:42Z,use_quota=True,user_id='46bae4f567474b61bbb708f4537dfe43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Creating volume ac972b5d-23b6-4ca3-9cbc-f717d7c805fb {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:42 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:42 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb 1073741824 Sep 28 15:12:42 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Created reservations ['ff3c7e20-bbee-443a-9c96-ea416ed2723b', '082ce00e-6e28-4023-866f-ec7fa90e1870', '1d3408ea-8fd8-471e-a75d-f0c3364a9fdd', '7d526f37-e738-446e-ad2f-ad4cebe3041e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:42 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:42 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:42 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.295s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Deleted volume successfully. Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-98320c76-6135-4616-92d1-7b9ae1d1ce8c tempest-VolumesImageMetadata-382069853 None] Lock "cinder-fa810bbc-22a9-408c-a246-edfa61fab7d8-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:42 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb 1073741824" returned: 0 in 0.581s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:42 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb Sep 28 15:12:42 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:43 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb" returned: 0 in 0.353s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a062927-0a09-427b-96bf-49c3ecd134de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224198d8-d1a1-45bb-8af8-63c3f4f243de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:43 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Volume volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb (ac972b5d-23b6-4ca3-9cbc-f717d7c805fb): created successfully Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224198d8-d1a1-45bb-8af8-63c3f4f243de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Flow 'volume_create_manager' (7bf5e02a-d9ab-4f49-bb89-f4bb71fba3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-93469cd6-3535-4851-bbaa-e3a4f9641e02 tempest-VolumesListTestJSON-188018637 None] Created volume successfully. Sep 28 15:12:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9089ec78-4a16-4e25-8282-30caa9c9a2f5 tempest-GroupSnapshotsTest-2110138437 None] Group tempest-GroupSnapshotsTest-Group-802960301: creating Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Flow 'volume_create_manager' (439b2dfe-f290-48b1-8a77-eb5b97fb78c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff4b71f-1053-442f-8512-01660567bf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff4b71f-1053-442f-8512-01660567bf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1285136425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3897a79b-1f64-4bff-a2c9-7887d33dd60e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b76fe3dce69947fe9ed64cc4e2b3bf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:45Z,use_quota=True,user_id='46bae4f567474b61bbb708f4537dfe43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b76016d-ef9c-45a8-9624-5382f80ecbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b76016d-ef9c-45a8-9624-5382f80ecbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f499571-da5c-41ae-bd32-c402a468792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f499571-da5c-41ae-bd32-c402a468792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3897a79b-1f64-4bff-a2c9-7887d33dd60e', 'volume_name': 'volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229b216-d4eb-4642-8500-c05ba824966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229b216-d4eb-4642-8500-c05ba824966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f78652c-653a-409b-9322-d2de70bfaa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:45 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Volume 3897a79b-1f64-4bff-a2c9-7887d33dd60e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e', 'volume_size': 1} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1285136425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3897a79b-1f64-4bff-a2c9-7887d33dd60e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b76fe3dce69947fe9ed64cc4e2b3bf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:45Z,use_quota=True,user_id='46bae4f567474b61bbb708f4537dfe43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Creating volume 3897a79b-1f64-4bff-a2c9-7887d33dd60e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:45 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9089ec78-4a16-4e25-8282-30caa9c9a2f5 tempest-GroupSnapshotsTest-2110138437 None] Group tempest-GroupSnapshotsTest-Group-802960301: created successfully Sep 28 15:12:45 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e 1073741824 Sep 28 15:12:45 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9089ec78-4a16-4e25-8282-30caa9c9a2f5 tempest-GroupSnapshotsTest-2110138437 None] Create group completed successfully. Sep 28 15:12:45 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e 1073741824" returned: 0 in 0.658s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:45 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e Sep 28 15:12:45 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:46 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e" returned: 0 in 0.323s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f78652c-653a-409b-9322-d2de70bfaa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646c56fb-1f56-4525-99a6-cf359c179d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Volume volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e (3897a79b-1f64-4bff-a2c9-7887d33dd60e): created successfully Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646c56fb-1f56-4525-99a6-cf359c179d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Flow 'volume_create_manager' (439b2dfe-f290-48b1-8a77-eb5b97fb78c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0d76ed63-ba18-4744-9c55-179592143cb4 tempest-VolumesListTestJSON-188018637 None] Created volume successfully. Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (89523eee-855f-456d-99f5-38c877b1c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5686ac95-970f-44ab-b7d4-8bed92b26fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5686ac95-970f-44ab-b7d4-8bed92b26fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004399510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a149c21-96fe-4db4-bf9b-cc8ed3c2ee6e,host='devstack@QuobyteHD#QuobyteHD',id=80955373-0919-4a71-becd-21db56aacdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:47Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14da1cf8-bd66-4531-b6f8-28ff46e80c0c),volume_type_id=14da1cf8-bd66-4531-b6f8-28ff46e80c0c)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a97bcf-7db9-40c8-9801-27b188aa66a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a97bcf-7db9-40c8-9801-27b188aa66a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1df00f2-6600-431b-9cb2-2f2f185fd88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1df00f2-6600-431b-9cb2-2f2f185fd88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80955373-0919-4a71-becd-21db56aacdfc', 'volume_name': 'volume-80955373-0919-4a71-becd-21db56aacdfc', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e689b89b-c2df-4ae3-86c2-9fadd0710b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e689b89b-c2df-4ae3-86c2-9fadd0710b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372dc891-89c8-4bff-a6d8-c55c8c1d8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Volume 80955373-0919-4a71-becd-21db56aacdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80955373-0919-4a71-becd-21db56aacdfc', 'volume_size': 1} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a149c21-96fe-4db4-bf9b-cc8ed3c2ee6e,created_at=2026-09-28T13:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004399510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a149c21-96fe-4db4-bf9b-cc8ed3c2ee6e,host='devstack@QuobyteHD#QuobyteHD',id=80955373-0919-4a71-becd-21db56aacdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:47Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14da1cf8-bd66-4531-b6f8-28ff46e80c0c),volume_type_id=14da1cf8-bd66-4531-b6f8-28ff46e80c0c)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Creating volume 80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:46 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:46 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc 1073741824 Sep 28 15:12:46 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:47 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc 1073741824" returned: 0 in 0.545s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:47 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:12:47 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:47 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.333s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Flow 'volume_create_manager' (fea32fcb-3370-405a-8a5b-2d3aa7ad0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1d9de1-3ec5-452f-8e40-3f337e485bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372dc891-89c8-4bff-a6d8-c55c8c1d8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80955373-0919-4a71-becd-21db56aacdfc', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248df42-fa3a-4a61-a667-d15d976b4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1d9de1-3ec5-452f-8e40-3f337e485bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-527251499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517adae8-7713-496b-85c6-ad6585700562,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b76fe3dce69947fe9ed64cc4e2b3bf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:48Z,use_quota=True,user_id='46bae4f567474b61bbb708f4537dfe43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2ada91-87c2-44d4-bb83-9b59cc195518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2ada91-87c2-44d4-bb83-9b59cc195518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ce34a2-a9aa-47c1-a490-57bb05236374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ce34a2-a9aa-47c1-a490-57bb05236374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517adae8-7713-496b-85c6-ad6585700562', 'volume_name': 'volume-517adae8-7713-496b-85c6-ad6585700562', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3585ff4c-8287-476b-b5dc-d756f07f9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3585ff4c-8287-476b-b5dc-d756f07f9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2992d21f-2b10-4c3e-bf05-e847fb651e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Volume 517adae8-7713-496b-85c6-ad6585700562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517adae8-7713-496b-85c6-ad6585700562', 'volume_size': 1} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-527251499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517adae8-7713-496b-85c6-ad6585700562,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b76fe3dce69947fe9ed64cc4e2b3bf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:48Z,use_quota=True,user_id='46bae4f567474b61bbb708f4537dfe43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Creating volume 517adae8-7713-496b-85c6-ad6585700562 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:47 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Volume volume-80955373-0919-4a71-becd-21db56aacdfc (80955373-0919-4a71-becd-21db56aacdfc): created successfully Sep 28 15:12:47 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 1073741824 Sep 28 15:12:47 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248df42-fa3a-4a61-a667-d15d976b4f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (89523eee-855f-456d-99f5-38c877b1c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-705d78bf-8750-4275-921d-46325cd63830 tempest-GroupSnapshotsTest-2110138437 None] Created volume successfully. Sep 28 15:12:48 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 1073741824" returned: 0 in 0.559s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:48 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 Sep 28 15:12:48 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Flow 'volume_create_manager' (7a30e6d5-e923-420f-b78b-a7768411e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5014a5-c43b-40bf-99c3-ffebdc6d8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5014a5-c43b-40bf-99c3-ffebdc6d8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1999780887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3448929-5ed6-4738-9b98-26fa5d4427cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e21d4e3b3224fe5bf18b23b159608a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:48Z,use_quota=True,user_id='f7fc429a1e3d479fa7d62280ac47b680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8521a4bf-a37d-4de6-81fb-b2a36d144971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8521a4bf-a37d-4de6-81fb-b2a36d144971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad07228-84e6-4fe2-a7eb-b7f772ea2e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:12:48 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562" returned: 0 in 0.266s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2992d21f-2b10-4c3e-bf05-e847fb651e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517adae8-7713-496b-85c6-ad6585700562', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170d0ce0-8b4f-4a02-aabf-b6eb9b6361e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Volume volume-517adae8-7713-496b-85c6-ad6585700562 (517adae8-7713-496b-85c6-ad6585700562): created successfully Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170d0ce0-8b4f-4a02-aabf-b6eb9b6361e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Flow 'volume_create_manager' (fea32fcb-3370-405a-8a5b-2d3aa7ad0961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-53996a3d-29e3-4844-9d8b-901c267d7525 tempest-VolumesListTestJSON-188018637 None] Created volume successfully. Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad07228-84e6-4fe2-a7eb-b7f772ea2e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3448929-5ed6-4738-9b98-26fa5d4427cb', 'volume_name': 'volume-c3448929-5ed6-4738-9b98-26fa5d4427cb', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d0f169-5b4d-4d68-b24d-3b44e631d077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d0f169-5b4d-4d68-b24d-3b44e631d077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab92e86-2c84-4486-a995-2eec46c18bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Volume c3448929-5ed6-4738-9b98-26fa5d4427cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3448929-5ed6-4738-9b98-26fa5d4427cb', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:12:48 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Trying to clone c3448929-5ed6-4738-9b98-26fa5d4427cb from image 014259cc-3d70-4b12-abe4-95d560fe7bff at location (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:12:49 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e08359-d440-4ff0-aed9-c98193f6fabb]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] GroupSnapshot 843db1d7-53d8-437d-8c81-b4d2b66c7418: creating. Sep 28 15:12:49 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD Sep 28 15:12:49 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Group snapshot 843db1d7-53d8-437d-8c81-b4d2b66c7418: creating. {{(pid=86888) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Creating offline snapshot a59f82f4-4d45-4214-bab4-dd85d352fa2e of volume 80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a58372-7856-454a-883d-dd8a594a7dce]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:49 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:12:49 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff is fetched for user f7fc429a1e3d479fa7d62280ac47b680. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05af64-c70c-41ce-9ac7-27aec437a947]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:49 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD Sep 28 15:12:49 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:49 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.461s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:50 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e 1G Sep 28 15:12:50 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:50 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:50 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e 1G" returned: 0 in 0.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80955373-0919-4a71-becd-21db56aacdfc -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:50 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80955373-0919-4a71-becd-21db56aacdfc -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e Sep 28 15:12:50 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:50 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80955373-0919-4a71-becd-21db56aacdfc -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e" returned: 0 in 0.337s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:50 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:12:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:50 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e Sep 28 15:12:50 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:51 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e" returned: 0 in 0.293s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:51 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info Sep 28 15:12:51 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:51 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info" returned: 0 in 0.278s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:51 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:51 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info Sep 28 15:12:51 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:51 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.info" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1999780887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3448929-5ed6-4738-9b98-26fa5d4427cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e21d4e3b3224fe5bf18b23b159608a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:48Z,use_quota=True,user_id='f7fc429a1e3d479fa7d62280ac47b680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Creating volume c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:51 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:12:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:51 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 1073741824 Sep 28 15:12:51 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6f38a3fe-5fcd-47ed-b6c4-cc5f66171102 tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 843db1d7-53d8-437d-8c81-b4d2b66c7418: created successfully Sep 28 15:12:52 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 1073741824" returned: 0 in 0.550s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:52 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:12:52 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Acquiring lock "cinder-517adae8-7713-496b-85c6-ad6585700562-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Lock "cinder-517adae8-7713-496b-85c6-ad6585700562-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:52 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 0 in 0.398s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Acquiring lock "cinder-quobyte-517adae8-7713-496b-85c6-ad6585700562" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Lock "cinder-quobyte-517adae8-7713-496b-85c6-ad6585700562" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Attempting download of 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume c3448929-5ed6-4738-9b98-26fa5d4427cb. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[88537e82-3c02-47cd-9b5b-64aa80b804e7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed85a7c-2d21-4b84-9eb6-cb427ab07836]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:53 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 Sep 28 15:12:53 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps Sep 28 15:12:53 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562" returned: 0 in 0.484s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:53 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562 Sep 28 15:12:53 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps" returned: 0 in 0.519s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-a59f82f4-4d45-4214-bab4-dd85d352fa2e-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-a59f82f4-4d45-4214-bab4-dd85d352fa2e-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Creating volume e1e215e4-b2a3-4e36-a4fd-d5702340fb2e from snapshot a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:53 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps Sep 28 15:12:53 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] snapshot: a59f82f4-4d45-4214-bab4-dd85d352fa2e, volume: e1e215e4-b2a3-4e36-a4fd-d5702340fb2e, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a720cb5-de8d-4d92-a3fc-01beeeaea777]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:53 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-517adae8-7713-496b-85c6-ad6585700562" returned: 0 in 0.433s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Lock "cinder-quobyte-517adae8-7713-496b-85c6-ad6585700562" released by "delete_volume" :: held 0.991s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Created reservations ['12b9c0ad-c0cf-47dd-805a-248e80949c0f', '4f996aff-b5ee-4061-9f09-d17047db4ba9', '2c870141-05e2-40c8-90ee-41846e4a6924', '1ff4469f-987d-435d-84f1-e4a9753d33a2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:53 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:53 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e Sep 28 15:12:53 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps" returned: 1 in 0.503s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_5h6mhhps' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[795bb33f-6ab1-4ae3-b90c-e7bb22a341ed]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:54 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:54 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD Sep 28 15:12:54 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "cinder-3897a79b-1f64-4bff-a2c9-7887d33dd60e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-3897a79b-1f64-4bff-a2c9-7887d33dd60e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "cinder-quobyte-3897a79b-1f64-4bff-a2c9-7887d33dd60e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-quobyte-3897a79b-1f64-4bff-a2c9-7887d33dd60e" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:54 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e" returned: 0 in 0.654s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80955373-0919-4a71-becd-21db56aacdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d140856-6941-4016-b681-57061b66d902]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc547a24-0f59-43e5-b511-60c22b263e94]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.399s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Deleted volume successfully. Sep 28 15:12:54 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] 014259cc-3d70-4b12-abe4-95d560fe7bff was qcow2, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a115e425-b8b4-4886-8d3a-2eed2c6b3f3c tempest-VolumesListTestJSON-188018637 None] Lock "cinder-517adae8-7713-496b-85c6-ad6585700562-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:54 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:12:54 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:54 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e Sep 28 15:12:54 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:54 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:12:54 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:54 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e" returned: 0 in 0.496s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:54 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.509s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:55 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:55 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:55 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e Sep 28 15:12:55 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:55 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3897a79b-1f64-4bff-a2c9-7887d33dd60e" returned: 0 in 0.385s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-quobyte-3897a79b-1f64-4bff-a2c9-7887d33dd60e" released by "delete_volume" :: held 0.981s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Created reservations ['852915fe-f36e-4d53-9e01-f42db88f032c', '04f69ff9-5c7f-428d-8959-4af3efb606d4', 'f85c3a30-21ae-4b32-a794-c05b80d39311', '08dfb631-8e63-464d-9567-4c93875f0cbb'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:55 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:55 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:56 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.647s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:56 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Deleted volume successfully. Sep 28 15:12:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d4228a3-4bc2-4c45-b68e-dea4da02cce5 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-3897a79b-1f64-4bff-a2c9-7887d33dd60e-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "cinder-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "cinder-quobyte-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-quobyte-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c60843-df1d-42e1-bc59-342e4c09aa03]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:57 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb Sep 28 15:12:57 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:57 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 0 in 3.232s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_zu_209atdevstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:12:57 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Converted 112.00 MB image at 34.60 MB/s Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:57 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 1G Sep 28 15:12:57 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:57 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb" returned: 0 in 0.783s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb Sep 28 15:12:58 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:58 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 1G" returned: 0 in 0.687s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:58 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb" returned: 0 in 0.559s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-quobyte-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb" released by "delete_volume" :: held 1.423s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[29470d33-2cb1-4eab-ac22-b3d07ee0d397]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Created reservations ['0a89d218-322b-4b6d-8ac0-ae1c23b3e379', '70954539-f341-47db-9b05-9def156e33ee', '8f4c134d-5d18-4ed8-b839-bee878347b86', '5aaa75e1-1b76-4577-abfa-7080a7a56906'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:58 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:12:58 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:12:58 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:59 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 0 in 0.895s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:59 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.613s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:59 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Deleted volume successfully. Sep 28 15:12:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5332911-9d7e-46de-b6f7-ddcb91986739 tempest-VolumesListTestJSON-188018637 None] Lock "cinder-ac972b5d-23b6-4ca3-9cbc-f717d7c805fb-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:59 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:12:59 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:00 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 1 in 0.813s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Downloaded image 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume c3448929-5ed6-4738-9b98-26fa5d4427cb successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff for user f7fc429a1e3d479fa7d62280ac47b680 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Marking volume c3448929-5ed6-4738-9b98-26fa5d4427cb as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Copying metadata from image 014259cc-3d70-4b12-abe4-95d560fe7bff to c3448929-5ed6-4738-9b98-26fa5d4427cb. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Creating volume glance metadata for volume c3448929-5ed6-4738-9b98-26fa5d4427cb backed by image 014259cc-3d70-4b12-abe4-95d560fe7bff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab92e86-2c84-4486-a995-2eec46c18bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3448929-5ed6-4738-9b98-26fa5d4427cb', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457f5c44-2f9b-456d-ada3-b4dc08fb52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Volume volume-c3448929-5ed6-4738-9b98-26fa5d4427cb (c3448929-5ed6-4738-9b98-26fa5d4427cb): created successfully Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457f5c44-2f9b-456d-ada3-b4dc08fb52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Flow 'volume_create_manager' (7a30e6d5-e923-420f-b78b-a7768411e13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1f592461-f7b8-4343-964c-9c19f2b4f7ad tempest-VolumesExtendTest-1703070027 None] Created volume successfully. Sep 28 15:13:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:03 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" returned: 0 in 8.890s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:03 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[634e30f9-2cc0-4a19-bb7c-c8f949510f23]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:04 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:13:04 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:04 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.641s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:13:04 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Converted 1024.00 MB image at 115.17 MB/s Sep 28 15:13:04 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:04 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e Sep 28 15:13:04 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:04 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" returned: 0 in 0.340s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" released by "_copy_volume_from_snapshot" :: held 11.236s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-a59f82f4-4d45-4214-bab4-dd85d352fa2e-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" released by "_create_volume_from_snapshot" :: held 11.295s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.329s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.620s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd13b35-cb3e-47cb-8866-0c3bdea33ac5]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:05 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-93dbdc47-8e88-4575-baad-9e0fc8ad45f8 tempest-GroupSnapshotsTest-2110138437 None] Create group from source-snapshot-843db1d7-53d8-437d-8c81-b4d2b66c7418 completed successfully. Sep 28 15:13:05 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:13:05 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:05 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 0 in 0.486s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:05 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:13:05 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:05 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 1 in 0.483s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:13:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 2G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb 2G" returned: 0 in 0.086s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.128s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.667s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[716d6684-7363-4193-83e4-f46d04648d81]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4cbd57f3-8114-4657-af06-400fd33fb8e2 tempest-VolumesExtendTest-1703070027 None] Extend volume completed successfully. Sep 28 15:13:06 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 Sep 28 15:13:06 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:06 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41" returned: 0 in 0.483s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.525s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=97,cinder:UPDATE=120,cinder:DELETE=5,cinder:INSERT=41 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=106,cinder:DELETE=15,cinder:SELECT=101,cinder:INSERT=33 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-bb86f15c-5b78-4fb3-8335-278ca986db41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa2f3da7-2ead-48f2-ac57-7a5af6c7fed9', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:13:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c5d3e0a6-01f2-4ab9-a721-322711850bac req-74a5584d-5fcc-4ba6-8b74-fc3bce71ac0d tempest-TestStampPattern-237515929 None] attachment_update completed successfully. Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b65de-3e4e-48e4-a6db-8154a1326ca5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:07 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e Sep 28 15:13:07 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:07 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" returned: 0 in 0.577s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:07 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e Sep 28 15:13:07 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:07 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" returned: 0 in 0.427s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-c3448929-5ed6-4738-9b98-26fa5d4427cb-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-e1e215e4-b2a3-4e36-a4fd-d5702340fb2e" released by "delete_volume" :: held 1.077s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-c3448929-5ed6-4738-9b98-26fa5d4427cb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-quobyte-c3448929-5ed6-4738-9b98-26fa5d4427cb" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-c3448929-5ed6-4738-9b98-26fa5d4427cb" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['5083615a-ef9d-4502-80d2-320cbe723334'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc6aa62-a205-48cf-af67-d1e8d2b9a1a2]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:08 devstack cinder-volume[86888]: WARNING cinder.quota [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1418673322 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1418673322, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:13:08 devstack cinder-volume[86888]: WARNING cinder.quota [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1418673322 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1418673322, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['1f1e388c-320b-466e-a356-38c5e1ae3a36', 'd01799e1-2301-4449-a443-273e06c98ac4', '831f4076-a14e-4978-adba-65f41a2c28ba', 'eb378d80-71bb-4a3d-9c49-b53a30abf7f0'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:08 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:13:08 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:08 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:08 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:08 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 0 in 0.545s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:08 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.414s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:08 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-795a6c10-6130-40c3-ac17-3fa684c6a586 tempest-GroupSnapshotsTest-2110138437 None] Delete group completed successfully. Sep 28 15:13:08 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:13:08 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:09 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 1 in 0.554s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:09 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb Sep 28 15:13:09 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 843db1d7-53d8-437d-8c81-b4d2b66c7418: deleting Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 843db1d7-53d8-437d-8c81-b4d2b66c7418: deleting {{(pid=86888) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:13:09 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c3448929-5ed6-4738-9b98-26fa5d4427cb" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-c3448929-5ed6-4738-9b98-26fa5d4427cb" released by "delete_volume" :: held 1.622s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-80955373-0919-4a71-becd-21db56aacdfc" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-80955373-0919-4a71-becd-21db56aacdfc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-a59f82f4-4d45-4214-bab4-dd85d352fa2e" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-a59f82f4-4d45-4214-bab4-dd85d352fa2e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Deleting offline snapshot a59f82f4-4d45-4214-bab4-dd85d352fa2e of volume 80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] snapshot_file for this snap is: volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be445de-85d9-441d-979c-5f50d70be969]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:09 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Created reservations ['e881de6a-3cd1-4266-b7bb-4addb2971f91', '0bbb45cb-c46b-4467-b330-909d50c53470', '798c7600-672e-4a43-8c73-0b9520de0867', 'b0dbdd7b-8192-45a2-9aad-3388786604a5'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:10 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e Sep 28 15:13:10 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:10 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:10 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:10 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e" returned: 0 in 0.717s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80955373-0919-4a71-becd-21db56aacdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:10 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.556s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9f996-24e8-4521-9620-0ec7b53bc1d1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Deleted volume successfully. Sep 28 15:13:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-661df917-2fb8-412c-a28f-7730e7731c51 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-c3448929-5ed6-4738-9b98-26fa5d4427cb-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:10 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:13:10 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-430c9c2a-34f6-4d08-b7d6-2db01ad17fd1 req-89728cf6-7799-4596-9635-118de0c535c0 tempest-TestStampPattern-237515929 None] Terminate volume connection completed successfully. Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-430c9c2a-34f6-4d08-b7d6-2db01ad17fd1 req-89728cf6-7799-4596-9635-118de0c535c0 tempest-TestStampPattern-237515929 None] Deleting attachment fa2f3da7-2ead-48f2-ac57-7a5af6c7fed9. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Flow 'volume_create_manager' (640cb5e0-f45e-4dbd-ab03-82029f365b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9076742-a85e-4796-87d5-c1854f860e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9076742-a85e-4796-87d5-c1854f860e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1482382368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73694470-7e96-4bac-b5ce-29ae2fbd41f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e21d4e3b3224fe5bf18b23b159608a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:11Z,use_quota=True,user_id='f7fc429a1e3d479fa7d62280ac47b680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04723f7f-daed-481c-ae80-b69ddba18cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04723f7f-daed-481c-ae80-b69ddba18cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2b9164-3ce0-4c1b-b7c5-5f2c24ff9b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2b9164-3ce0-4c1b-b7c5-5f2c24ff9b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73694470-7e96-4bac-b5ce-29ae2fbd41f0', 'volume_name': 'volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b2d832-980d-482b-90eb-8650cbc5d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b2d832-980d-482b-90eb-8650cbc5d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae70f328-2746-4363-a80d-82b92eaacb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Volume 73694470-7e96-4bac-b5ce-29ae2fbd41f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0', 'volume_size': 1} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1482382368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73694470-7e96-4bac-b5ce-29ae2fbd41f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e21d4e3b3224fe5bf18b23b159608a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:11Z,use_quota=True,user_id='f7fc429a1e3d479fa7d62280ac47b680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Creating volume 73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:11 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:11 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.683s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:11 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 1073741824 Sep 28 15:13:11 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:11 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e Sep 28 15:13:11 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:11 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e" returned: 0 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:11 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e Sep 28 15:13:11 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:11 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 1073741824" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:12 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 Sep 28 15:13:12 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:12 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc.a59f82f4-4d45-4214-bab4-dd85d352fa2e" returned: 0 in 0.343s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-a59f82f4-4d45-4214-bab4-dd85d352fa2e" released by "_delete_snapshot" :: held 2.393s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-80955373-0919-4a71-becd-21db56aacdfc" released by "delete_snapshot" :: held 2.437s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:12 devstack cinder-volume[86888]: WARNING cinder.quota [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1418673322 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1418673322, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['586499e1-92ae-4550-bb30-9d87ca83c543', '0fc20542-8930-4580-9c2c-3f38416e1018', '02b76136-f4cb-4853-983d-3c7753116c58', '73d9828e-224e-44b1-96cf-7c5b983d4d4e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:12 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0" returned: 0 in 0.549s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae70f328-2746-4363-a80d-82b92eaacb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f15475-5f0f-4c48-813d-8086da51a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:12 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Volume volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 (73694470-7e96-4bac-b5ce-29ae2fbd41f0): created successfully Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f15475-5f0f-4c48-813d-8086da51a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Flow 'volume_create_manager' (640cb5e0-f45e-4dbd-ab03-82029f365b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8804094b-8acf-4d76-85e6-b6266ffaccd6 tempest-VolumesExtendTest-1703070027 None] Created volume successfully. Sep 28 15:13:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ec07bc2c-3793-465e-abf6-f3ed559d8c43 tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 843db1d7-53d8-437d-8c81-b4d2b66c7418: deleted successfully Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Creating offline snapshot a9db658b-e836-4dd6-96a2-b2611b7ec777 of volume 73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a94fef-6158-4c0a-a504-0a7bd31f8977]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-80955373-0919-4a71-becd-21db56aacdfc" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-80955373-0919-4a71-becd-21db56aacdfc" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:13 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 Sep 28 15:13:13 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9756bef-f3ad-4961-84bb-39e093c1bceb]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:14 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:13:14 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0" returned: 0 in 0.559s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:14 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 1G Sep 28 15:13:14 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.507s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:14 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc Sep 28 15:13:14 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:14 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80955373-0919-4a71-becd-21db56aacdfc" returned: 0 in 0.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-80955373-0919-4a71-becd-21db56aacdfc" released by "delete_volume" :: held 1.173s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 1G" returned: 0 in 0.770s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:15 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 Sep 28 15:13:15 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['5ba6e98a-0d89-4749-9523-697582428252'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:15 devstack cinder-volume[86888]: WARNING cinder.db.api [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1418673322'] Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['8edd4d78-a8de-4a00-ab80-0306e3eefad7', '471ebb89-22f0-4d7b-92c4-bd9339c62070', '2e703481-2950-4c3b-b293-3304bdfe76d8', '4e7a395d-46b9-46db-8d73-cb88ced59e11'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:15 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777" returned: 0 in 0.705s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:15 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 is being set with open permissions: ugo+rw Sep 28 15:13:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:15 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:15 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:15 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 Sep 28 15:13:15 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:16 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.594s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:16 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-012614e4-7c34-491b-aa05-42c085016cc1 tempest-GroupSnapshotsTest-2110138437 None] Delete group completed successfully. Sep 28 15:13:16 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777" returned: 0 in 0.667s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:16 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info Sep 28 15:13:16 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:16 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info" returned: 0 in 0.434s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:16 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info is being set with open permissions: ugo+rw Sep 28 15:13:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:16 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info Sep 28 15:13:16 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:17 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.info" returned: 0 in 0.432s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.764s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-25ccdbc2-9952-4065-827b-ad9e8efeaee7 tempest-VolumesExtendTest-1703070027 None] Create snapshot completed successfully Sep 28 15:13:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cc058688-ab74-4783-a9c4-03ce4b24313d tempest-GroupSnapshotsTest-2110138437 None] Group tempest-GroupSnapshotsTest-Group-1020234745: creating Sep 28 15:13:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cc058688-ab74-4783-a9c4-03ce4b24313d tempest-GroupSnapshotsTest-2110138437 None] Group tempest-GroupSnapshotsTest-Group-1020234745: created successfully Sep 28 15:13:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cc058688-ab74-4783-a9c4-03ce4b24313d tempest-GroupSnapshotsTest-2110138437 None] Create group completed successfully. Sep 28 15:13:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[591cb731-4a59-43e5-bb1d-4f355e0a73be]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 Sep 28 15:13:18 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:18 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0" returned: 0 in 0.559s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 2G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 2G" returned: 0 in 0.290s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.932s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f698aa4b-f443-4b31-84a5-00500f20adf4 tempest-VolumesExtendTest-1703070027 None] Extend volume completed successfully. Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-a9db658b-e836-4dd6-96a2-b2611b7ec777-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-a9db658b-e836-4dd6-96a2-b2611b7ec777-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-quobyte-73694470-7e96-4bac-b5ce-29ae2fbd41f0" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (8fc56b58-d8f1-439f-aedb-bad87356c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3030fd-4e67-4371-a095-799a734d76ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-73694470-7e96-4bac-b5ce-29ae2fbd41f0" acquired by "delete_snapshot" :: waited 0.122s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-quobyte-a9db658b-e836-4dd6-96a2-b2611b7ec777" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3030fd-4e67-4371-a095-799a734d76ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364877374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44682126-a10c-4563-81d5-3706af88f16a,host='devstack@QuobyteHD#QuobyteHD',id=0a590486-2277-4cec-ac03-7e73a6b3ee9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:20Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8921f6ca-5087-438b-9449-809e83c6cfdf),volume_type_id=8921f6ca-5087-438b-9449-809e83c6cfdf)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413c82f3-d0fc-46c2-bae4-20f2aa077eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413c82f3-d0fc-46c2-bae4-20f2aa077eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8216b63a-2f35-4706-9352-966bd4fd92d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8216b63a-2f35-4706-9352-966bd4fd92d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a590486-2277-4cec-ac03-7e73a6b3ee9f', 'volume_name': 'volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ed35bb-828d-4897-b715-af5767e18a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ed35bb-828d-4897-b715-af5767e18a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09121395-777c-49dd-99e2-bfe8405fa0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:20 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Volume 0a590486-2277-4cec-ac03-7e73a6b3ee9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f', 'volume_size': 1} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=44682126-a10c-4563-81d5-3706af88f16a,created_at=2026-09-28T13:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364877374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44682126-a10c-4563-81d5-3706af88f16a,host='devstack@QuobyteHD#QuobyteHD',id=0a590486-2277-4cec-ac03-7e73a6b3ee9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:20Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8921f6ca-5087-438b-9449-809e83c6cfdf),volume_type_id=8921f6ca-5087-438b-9449-809e83c6cfdf)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Creating volume 0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:20 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-a9db658b-e836-4dd6-96a2-b2611b7ec777" acquired by "_delete_snapshot" :: waited 0.196s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Deleting offline snapshot a9db658b-e836-4dd6-96a2-b2611b7ec777 of volume 73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:20 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f 1073741824 Sep 28 15:13:20 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] snapshot_file for this snap is: volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e1e35-13ce-45e8-8592-5ebebe6365da]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 Sep 28 15:13:20 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f 1073741824" returned: 0 in 0.768s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777" returned: 0 in 0.773s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:20 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f Sep 28 15:13:20 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e498ae4-bb02-4ea1-b2f0-bb5583fc86a8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:21 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 Sep 28 15:13:21 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:21 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09121395-777c-49dd-99e2-bfe8405fa0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7047bdb-e284-4f3d-8b2e-99e2a375f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:21 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Volume volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f (0a590486-2277-4cec-ac03-7e73a6b3ee9f): created successfully Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7047bdb-e284-4f3d-8b2e-99e2a375f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (8fc56b58-d8f1-439f-aedb-bad87356c723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5726ccfa-3520-4d6c-a92d-90715286758e tempest-GroupSnapshotsTest-2110138437 None] Created volume successfully. Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (fe5617fa-bee5-4332-b259-e2a2f9222b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bc376d-043b-44fc-bbfb-fcf6fcf398c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bc376d-043b-44fc-bbfb-fcf6fcf398c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2039244871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c3504-ee7b-4107-a7b0-550233179b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:21Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb73d98-49af-41d0-a49f-a122bd3e6737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb73d98-49af-41d0-a49f-a122bd3e6737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894dbcd8-0ba7-47f7-9277-05b0c402e1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894dbcd8-0ba7-47f7-9277-05b0c402e1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94c3504-ee7b-4107-a7b0-550233179b81', 'volume_name': 'volume-b94c3504-ee7b-4107-a7b0-550233179b81', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208717f7-856f-47e4-b60e-260f02bfe18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208717f7-856f-47e4-b60e-260f02bfe18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba7230e-5cbe-41e3-9f2e-8faf532ace12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:21 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Volume b94c3504-ee7b-4107-a7b0-550233179b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94c3504-ee7b-4107-a7b0-550233179b81', 'volume_size': 1} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2039244871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c3504-ee7b-4107-a7b0-550233179b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:21Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Creating volume b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:21 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:21 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 1073741824 Sep 28 15:13:21 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:21 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0" returned: 0 in 0.696s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-bb86f15c-5b78-4fb3-8335-278ca986db41-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Lock "cinder-bb86f15c-5b78-4fb3-8335-278ca986db41-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:21 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 Sep 28 15:13:21 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-quobyte-bb86f15c-5b78-4fb3-8335-278ca986db41" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-bb86f15c-5b78-4fb3-8335-278ca986db41" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7d44e9-4f28-46a0-96ff-a66a89b66053]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:22 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 Sep 28 15:13:22 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:22 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777" returned: 0 in 0.594s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 1073741824" returned: 0 in 0.662s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777 Sep 28 15:13:22 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:22 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 Sep 28 15:13:22 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:22 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41" returned: 0 in 0.688s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:22 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41 Sep 28 15:13:22 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:22 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0.a9db658b-e836-4dd6-96a2-b2611b7ec777" returned: 0 in 0.560s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81" returned: 0 in 0.549s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-a9db658b-e836-4dd6-96a2-b2611b7ec777" released by "_delete_snapshot" :: held 2.845s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-73694470-7e96-4bac-b5ce-29ae2fbd41f0" released by "delete_snapshot" :: held 3.057s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba7230e-5cbe-41e3-9f2e-8faf532ace12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94c3504-ee7b-4107-a7b0-550233179b81', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52c5152-f638-4877-b4b9-1a779a587b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Volume volume-b94c3504-ee7b-4107-a7b0-550233179b81 (b94c3504-ee7b-4107-a7b0-550233179b81): created successfully Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52c5152-f638-4877-b4b9-1a779a587b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (fe5617fa-bee5-4332-b259-e2a2f9222b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0ee4ad85-1639-48c8-86f1-8258e7075e2f tempest-VolumesSnapshotTestJSON-816067968 None] Created volume successfully. Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Created reservations ['a61578a1-0d30-4721-bb33-bef8c6974957', '0cc9005f-60b0-43c7-bb53-68054b6f0687', '0c07aa1d-19a5-4b38-82c5-c511386c9173', '5ea3804d-0edb-4389-9a41-762cd4d2374e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:23 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb86f15c-5b78-4fb3-8335-278ca986db41" returned: 0 in 0.476s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-bb86f15c-5b78-4fb3-8335-278ca986db41" released by "delete_volume" :: held 1.231s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Delete snapshot completed successfully. Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-161ef338-5e0f-4c13-8e27-6948b724bb38 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-a9db658b-e836-4dd6-96a2-b2611b7ec777-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Created reservations ['7ff031eb-e3c9-4efe-aa7b-ae0214ccacfa', '9e57a32f-7ec2-40f9-88d8-d74029075c99', 'ffe7ad63-37a5-4ac9-a9da-15f24dd28bb7', '44160c0b-3cfe-4f87-94b8-2cf43eb43af7'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:23 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:23 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (a113c06f-8a56-4afa-908f-c0e0d0de6e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a42e32f-d8b3-429c-8bc6-0fa555219474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a42e32f-d8b3-429c-8bc6-0fa555219474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282382972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44682126-a10c-4563-81d5-3706af88f16a,host='devstack@QuobyteHD#QuobyteHD',id=4d57eefb-4a43-474f-bc0a-dc2c33508be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:24Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8921f6ca-5087-438b-9449-809e83c6cfdf),volume_type_id=8921f6ca-5087-438b-9449-809e83c6cfdf)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6958a70-0166-46aa-b379-64a43819b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6958a70-0166-46aa-b379-64a43819b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348de785-1778-4e23-bbae-705c9f04165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348de785-1778-4e23-bbae-705c9f04165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d57eefb-4a43-474f-bc0a-dc2c33508be0', 'volume_name': 'volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afe076a-956a-441d-9eec-e41179ea6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afe076a-956a-441d-9eec-e41179ea6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005dd918-944c-4638-9ab1-ccf368c36e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Volume 4d57eefb-4a43-474f-bc0a-dc2c33508be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0', 'volume_size': 1} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=44682126-a10c-4563-81d5-3706af88f16a,created_at=2026-09-28T13:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282382972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44682126-a10c-4563-81d5-3706af88f16a,host='devstack@QuobyteHD#QuobyteHD',id=4d57eefb-4a43-474f-bc0a-dc2c33508be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:24Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8921f6ca-5087-438b-9449-809e83c6cfdf),volume_type_id=8921f6ca-5087-438b-9449-809e83c6cfdf)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Creating volume 4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:23 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.448s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Deleted volume successfully. Sep 28 15:13:23 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 1073741824 Sep 28 15:13:23 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-716e7a7d-3ffc-48a1-9980-b300567a575f tempest-TestStampPattern-237515929 None] Lock "cinder-bb86f15c-5b78-4fb3-8335-278ca986db41-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-73694470-7e96-4bac-b5ce-29ae2fbd41f0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-73694470-7e96-4bac-b5ce-29ae2fbd41f0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "cinder-quobyte-73694470-7e96-4bac-b5ce-29ae2fbd41f0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-73694470-7e96-4bac-b5ce-29ae2fbd41f0" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f65131-286a-46a8-adc8-9dbd8bd55131]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:24 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 Sep 28 15:13:24 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 1073741824" returned: 0 in 0.751s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-f5c81603-9c9e-4568-ac75-c51c89e28b38-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Lock "cinder-f5c81603-9c9e-4568-ac75-c51c89e28b38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-quobyte-22ca2da6-4fbb-4df6-a33c-20afd341d850" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:24 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 Sep 28 15:13:24 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-22ca2da6-4fbb-4df6-a33c-20afd341d850" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-quobyte-f5c81603-9c9e-4568-ac75-c51c89e28b38" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-f5c81603-9c9e-4568-ac75-c51c89e28b38" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Deleting offline snapshot f5c81603-9c9e-4568-ac75-c51c89e28b38 of volume 22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] snapshot_file for this snap is: volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[235b5934-0b17-4b90-a5c3-3a4eba8dafcb]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:24 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:24 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 Sep 28 15:13:24 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0 Sep 28 15:13:24 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:24 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.793s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005dd918-944c-4638-9ab1-ccf368c36e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf273dde-09df-46fd-a3ae-6af3f90edb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Creating offline snapshot 24aa07df-5408-44f9-9572-411acdd3827d of volume b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:25 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Volume volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 (4d57eefb-4a43-474f-bc0a-dc2c33508be0): created successfully Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf273dde-09df-46fd-a3ae-6af3f90edb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (a113c06f-8a56-4afa-908f-c0e0d0de6e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[50318d05-725f-4bc1-8ce8-80afef2c8f23]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-23ac6bdf-cc63-438c-b2a1-c119b7d429f7 tempest-GroupSnapshotsTest-2110138437 None] Created volume successfully. Sep 28 15:13:25 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 Sep 28 15:13:25 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:25 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-73694470-7e96-4bac-b5ce-29ae2fbd41f0" returned: 0 in 0.318s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-quobyte-73694470-7e96-4bac-b5ce-29ae2fbd41f0" released by "delete_volume" :: held 0.949s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:25 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38" returned: 0 in 0.525s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ca2da6-4fbb-4df6-a33c-20afd341d850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba37a9f3-7e66-4ae7-9415-5a69a0f92905]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Created reservations ['068b473a-20e7-4591-8b0a-4bdf062652f7', 'c816e4d7-c166-446a-8d71-5d5ed97f21be', '341b2155-a008-4156-8e70-ea31bd4363a4', '069abd2d-94af-40d3-b426-168260e00ca5'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:25 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:13:25 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:25 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:25 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81" returned: 0 in 0.485s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d 1G Sep 28 15:13:25 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:25 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.268s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:25 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Deleted volume successfully. Sep 28 15:13:25 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.438s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:25 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-583d8d58-69be-4814-a55a-f783cdcf1026 tempest-VolumesExtendTest-1703070027 None] Lock "cinder-73694470-7e96-4bac-b5ce-29ae2fbd41f0-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:25 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 Sep 28 15:13:25 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d 1G" returned: 0 in 0.525s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94c3504-ee7b-4107-a7b0-550233179b81 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94c3504-ee7b-4107-a7b0-550233179b81 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d Sep 28 15:13:26 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38" returned: 0 in 0.486s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38 Sep 28 15:13:26 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-977fa273-759c-4e69-a588-a3fd82481b34 tempest-GroupSnapshotsTest-2110138437 None] Update group completed successfully. Sep 28 15:13:26 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94c3504-ee7b-4107-a7b0-550233179b81 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d" returned: 0 in 0.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d is being set with open permissions: ugo+rw Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d Sep 28 15:13:26 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:26 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850.f5c81603-9c9e-4568-ac75-c51c89e28b38" returned: 0 in 0.312s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-f5c81603-9c9e-4568-ac75-c51c89e28b38" released by "_delete_snapshot" :: held 1.944s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-22ca2da6-4fbb-4df6-a33c-20afd341d850" released by "delete_snapshot" :: held 1.996s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Created reservations ['c2890b8a-c177-43f0-b33d-974edcaaaa9a', '7e11e819-be21-48a9-991a-dc1f458f494e', 'beb07646-ef09-4161-9430-0e131a9a0cbe', '9e98efaf-71a3-4a76-a964-f447a70e47dc'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:26 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d" returned: 0 in 0.373s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Delete snapshot completed successfully. Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-656ba8b4-9df9-4251-94fb-cfa1ac148bb4 tempest-TestStampPattern-237515929 None] Lock "cinder-f5c81603-9c9e-4568-ac75-c51c89e28b38-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:26 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info Sep 28 15:13:26 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:27 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info" returned: 0 in 0.331s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:27 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info is being set with open permissions: ugo+rw Sep 28 15:13:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:27 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info Sep 28 15:13:27 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:27 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f3468f0f-58d2-47c1-96f7-31f5c4ef864d tempest-GroupSnapshotsTest-2110138437 None] Update group completed successfully. Sep 28 15:13:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.info" returned: 0 in 0.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ddbab36b-d83e-4f4e-98f4-adac3c57faf9 tempest-VolumesSnapshotTestJSON-816067968 None] Create snapshot completed successfully Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-24aa07df-5408-44f9-9572-411acdd3827d-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-24aa07df-5408-44f9-9572-411acdd3827d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-b94c3504-ee7b-4107-a7b0-550233179b81" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b94c3504-ee7b-4107-a7b0-550233179b81" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-24aa07df-5408-44f9-9572-411acdd3827d" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-24aa07df-5408-44f9-9572-411acdd3827d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Deleting offline snapshot 24aa07df-5408-44f9-9572-411acdd3827d of volume b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] snapshot_file for this snap is: volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641d210-19ee-4f71-8533-c73c1a11d500]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3d7dc7f5-2ae7-476d-a6a8-c7b2567839cd tempest-GroupSnapshotsTest-2110138437 None] Update group completed successfully. Sep 28 15:13:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:29 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d Sep 28 15:13:29 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:29 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d" returned: 0 in 0.608s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b94c3504-ee7b-4107-a7b0-550233179b81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7bebf-ea62-4c57-8d88-0ab89273bc3a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:29 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 Sep 28 15:13:29 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f3bf403f-5c81-43a4-9eaa-c395330306b5 tempest-GroupSnapshotsTest-2110138437 None] Update group completed successfully. Sep 28 15:13:30 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81" returned: 0 in 0.775s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:30 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d Sep 28 15:13:30 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:30 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d" returned: 0 in 0.626s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:31 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d Sep 28 15:13:31 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:31 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81.24aa07df-5408-44f9-9572-411acdd3827d" returned: 0 in 0.389s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-24aa07df-5408-44f9-9572-411acdd3827d" released by "_delete_snapshot" :: held 2.624s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b94c3504-ee7b-4107-a7b0-550233179b81" released by "delete_snapshot" :: held 2.670s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:31 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['ff982374-dee0-40d8-9be4-754bdd93b720', 'c632ee6f-1607-490b-9d81-0464bc144790', '70a5e5a4-d2e1-4005-bb40-3427eaf7ddd4', 'f713fe50-156b-4642-ad0f-ea55ef2b347e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Delete snapshot completed successfully. Sep 28 15:13:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4a41d06b-1f53-4dad-9bc9-a41d0bb75b9e tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-24aa07df-5408-44f9-9572-411acdd3827d-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] GroupSnapshot 0ddb02b1-1396-4fa3-9f31-dc49454f35fa: creating. Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Group snapshot 0ddb02b1-1396-4fa3-9f31-dc49454f35fa: creating. {{(pid=86888) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Creating offline snapshot 08ce85f3-5e1b-4406-acae-94e5ce574501 of volume 0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f74641e-5293-4a60-a7d7-28808c86f78a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:32 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f Sep 28 15:13:32 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Flow 'volume_create_manager' (0d212158-6ff7-44fe-873b-c536ab54b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcfc3d0-f945-4d26-a034-82319a254729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcfc3d0-f945-4d26-a034-82319a254729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-913972692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76160c8-3f81-4cc4-978b-fbc58f0e3dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c27142d877490e8a032a9e368ea0f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:33Z,use_quota=True,user_id='c395f9bea5f04b08b9f7aa4d7f39ef50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a57772-d140-41af-9400-af60d92726f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a57772-d140-41af-9400-af60d92726f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7bc6f3-c257-4d4d-9a7f-05b6d2071d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7bc6f3-c257-4d4d-9a7f-05b6d2071d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76160c8-3f81-4cc4-978b-fbc58f0e3dc7', 'volume_name': 'volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbb58ab-c97c-4ba7-a29a-c7e5334ada96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbb58ab-c97c-4ba7-a29a-c7e5334ada96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76424bca-3fe3-4748-bd82-52704ee040fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Volume c76160c8-3f81-4cc4-978b-fbc58f0e3dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7', 'volume_size': 1} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:32 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f" returned: 0 in 0.594s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:33 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 1G Sep 28 15:13:33 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (e1c5b9cb-f568-498a-a852-6422ae56d117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebc52aa-d26d-42ce-a3cf-cf4f4141c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebc52aa-d26d-42ce-a3cf-cf4f4141c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1249524399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f1e858-d585-4ba4-92ec-5a76feb23bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:33Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be8a5ec-fcec-41bf-9e06-adfe25583c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be8a5ec-fcec-41bf-9e06-adfe25583c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0d2eee-daa8-4092-ad0a-49af868179c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0d2eee-daa8-4092-ad0a-49af868179c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f1e858-d585-4ba4-92ec-5a76feb23bf2', 'volume_name': 'volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7875404-0869-47c9-b48d-d2863c7d5a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7875404-0869-47c9-b48d-d2863c7d5a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d160da02-a162-4d0f-887c-36a7e0a5730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Volume 80f1e858-d585-4ba4-92ec-5a76feb23bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2', 'volume_size': 1} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:33 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 1G" returned: 0 in 0.541s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:33 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 Sep 28 15:13:33 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-22ca2da6-4fbb-4df6-a33c-20afd341d850-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Lock "cinder-22ca2da6-4fbb-4df6-a33c-20afd341d850-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Acquiring lock "cinder-quobyte-22ca2da6-4fbb-4df6-a33c-20afd341d850" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-22ca2da6-4fbb-4df6-a33c-20afd341d850" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec0e8d-582f-4daa-9dc8-098cb3b6fcd2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:33 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501" returned: 0 in 0.361s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:33 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:13:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:33 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:13:33 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:33 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 Sep 28 15:13:33 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:34 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501" returned: 0 in 0.264s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:34 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:34 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info Sep 28 15:13:34 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:34 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850 Sep 28 15:13:34 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:34 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-22ca2da6-4fbb-4df6-a33c-20afd341d850" returned: 0 in 0.300s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:34 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info" returned: 0 in 0.335s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:34 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Lock "cinder-quobyte-22ca2da6-4fbb-4df6-a33c-20afd341d850" released by "delete_volume" :: held 0.813s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:34 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info Sep 28 15:13:34 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Created reservations ['4604e213-c7a0-42d0-a8c6-cd9f101fd924', '377b3086-1a73-4a5a-8854-2d56050df2f8', '9c333f51-76be-48b7-b170-860e2c7c275c', '0392d4c3-50cd-4528-b2fd-427732ff13ca'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:34 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:34 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:34 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.info" returned: 0 in 0.346s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Creating offline snapshot 4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b of volume 4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7189403-2e03-4d99-b0d8-7777f69983cf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:35 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.387s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:35 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:35 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 Sep 28 15:13:35 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Deleted volume successfully. Sep 28 15:13:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a2444117-4bad-427b-aa2f-9e8a6c5e81e2 tempest-TestStampPattern-237515929 None] Lock "cinder-22ca2da6-4fbb-4df6-a33c-20afd341d850-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:35 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0" returned: 0 in 0.548s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:35 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b 1G Sep 28 15:13:35 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:36 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b 1G" returned: 0 in 0.514s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:36 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b Sep 28 15:13:36 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:36 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" returned: 0 in 0.365s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:36 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:13:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:36 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b Sep 28 15:13:36 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:36 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" returned: 0 in 0.326s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:36 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info Sep 28 15:13:36 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:37 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info" returned: 0 in 0.324s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:37 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:37 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info Sep 28 15:13:37 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:37 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.info" returned: 0 in 0.330s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.057s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1249524399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f1e858-d585-4ba4-92ec-5a76feb23bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:33Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Creating volume 80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:37 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:37 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 1073741824 Sep 28 15:13:37 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-43fca32c-4c6e-439d-a473-836eafdf7e96 tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0ddb02b1-1396-4fa3-9f31-dc49454f35fa: created successfully Sep 28 15:13:37 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 1073741824" returned: 0 in 0.557s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:38 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:13:38 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:38 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.275s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.495s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-913972692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76160c8-3f81-4cc4-978b-fbc58f0e3dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c27142d877490e8a032a9e368ea0f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:33Z,use_quota=True,user_id='c395f9bea5f04b08b9f7aa4d7f39ef50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Creating volume c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:38 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d160da02-a162-4d0f-887c-36a7e0a5730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:38 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 1073741824 Sep 28 15:13:38 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec15fc3-a59c-4024-8f04-1c23568779bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:38 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Volume volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 (80f1e858-d585-4ba4-92ec-5a76feb23bf2): created successfully Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec15fc3-a59c-4024-8f04-1c23568779bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (e1c5b9cb-f568-498a-a852-6422ae56d117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:38 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-134479e4-5b2b-4114-bb3d-f0ffb951da92 tempest-VolumesSnapshotTestJSON-816067968 None] Created volume successfully. Sep 28 15:13:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0ddb02b1-1396-4fa3-9f31-dc49454f35fa: deleting Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0ddb02b1-1396-4fa3-9f31-dc49454f35fa: deleting {{(pid=86888) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-0a590486-2277-4cec-ac03-7e73a6b3ee9f" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-0a590486-2277-4cec-ac03-7e73a6b3ee9f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-08ce85f3-5e1b-4406-acae-94e5ce574501" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-08ce85f3-5e1b-4406-acae-94e5ce574501" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Deleting offline snapshot 08ce85f3-5e1b-4406-acae-94e5ce574501 of volume 0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:39 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] snapshot_file for this snap is: volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 1073741824" returned: 0 in 0.935s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc62f85-bcda-43fe-8c38-63fa806ffff6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:39 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 Sep 28 15:13:39 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:39 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 Sep 28 15:13:39 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:39 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.583s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Creating offline snapshot 7b034f4f-731c-4167-8ce9-2b7c0c3e451b of volume 80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76424bca-3fe3-4748-bd82-52704ee040fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15239072-cfc6-4b7c-985e-d3c7f1a64772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[23559225-3709-419b-ba01-a0ad4a357553]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:39 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501" returned: 0 in 0.535s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Volume volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 (c76160c8-3f81-4cc4-978b-fbc58f0e3dc7): created successfully Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15239072-cfc6-4b7c-985e-d3c7f1a64772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Flow 'volume_create_manager' (0d212158-6ff7-44fe-873b-c536ab54b291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b8c82c-8884-4293-8a8c-910e1485e05c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d9d9a74f-ade3-44c2-98c4-bbcdf80fc097 tempest-VolumesNegativeTest-36951724 None] Created volume successfully. Sep 28 15:13:39 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:13:39 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:40 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f Sep 28 15:13:40 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:40 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f" returned: 0 in 0.512s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:40 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.635s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:40 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 Sep 28 15:13:40 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:40 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b 1G Sep 28 15:13:40 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:40 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:40 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:41 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.429s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:13:41 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501" returned: 0 in 0.679s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:41 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501 Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b 1G" returned: 0 in 0.711s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:41 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b Sep 28 15:13:41 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:41 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f.08ce85f3-5e1b-4406-acae-94e5ce574501" returned: 0 in 0.441s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-08ce85f3-5e1b-4406-acae-94e5ce574501" released by "_delete_snapshot" :: held 2.368s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-0a590486-2277-4cec-ac03-7e73a6b3ee9f" released by "delete_snapshot" :: held 2.425s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-4d57eefb-4a43-474f-bc0a-dc2c33508be0" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-4d57eefb-4a43-474f-bc0a-dc2c33508be0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:41 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b" returned: 0 in 0.566s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b is being set with open permissions: ugo+rw Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:41 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b Sep 28 15:13:41 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Deleting offline snapshot 4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b of volume 4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] snapshot_file for this snap is: volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce45aad-fea3-4424-a514-132f6883b3db]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:42 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b Sep 28 15:13:42 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:42 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b" returned: 0 in 0.387s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:42 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info Sep 28 15:13:42 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:42 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" returned: 0 in 0.588s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a400fe81-44c3-4949-9dde-83d79095524e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:42 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info" returned: 0 in 0.408s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:42 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info is being set with open permissions: ugo+rw Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:42 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info Sep 28 15:13:42 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:42 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 Sep 28 15:13:42 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:42 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.info" returned: 0 in 0.396s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a20dbf8f-51fc-4e32-bb96-f993423f1501 tempest-VolumesSnapshotTestJSON-816067968 None] Create snapshot completed successfully Sep 28 15:13:43 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0" returned: 0 in 0.659s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:43 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b Sep 28 15:13:43 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:43 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" returned: 0 in 0.493s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:43 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b Sep 28 15:13:43 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:44 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0.4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" returned: 0 in 0.487s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-4f1a4bfb-36bc-42f2-8e50-e4606bf69a3b" released by "_delete_snapshot" :: held 2.429s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-4d57eefb-4a43-474f-bc0a-dc2c33508be0" released by "delete_snapshot" :: held 2.503s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:44 devstack cinder-volume[86888]: WARNING cinder.quota [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-958233491 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-958233491, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:13:44 devstack cinder-volume[86888]: WARNING cinder.quota [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-958233491 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-958233491, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['5fdc8dc2-34e8-4702-8660-a2b22c154407', '09533fc3-0d8a-4f22-9774-8e3803a36917', 'a9d69913-a52e-4a39-ac4b-b034e655bc76', 'c4f2a14a-9aac-474a-b75e-2bcd1d930c70'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (00c89a85-459d-437c-a884-ca56cd299e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcf76ba-a2b8-406b-9b1e-8585da3c455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcf76ba-a2b8-406b-9b1e-8585da3c455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1594273824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86f6a0e-4419-44ad-ad1d-13db2519694d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7b034f4f-731c-4167-8ce9-2b7c0c3e451b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:44Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd185d1-c407-4f61-8026-c6468795f5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd185d1-c407-4f61-8026-c6468795f5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a865a7-195b-4d2e-84cc-24b2bbefdde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a865a7-195b-4d2e-84cc-24b2bbefdde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b86f6a0e-4419-44ad-ad1d-13db2519694d', 'volume_name': 'volume-b86f6a0e-4419-44ad-ad1d-13db2519694d', 'volume_size': 2, 'snapshot_id': '7b034f4f-731c-4167-8ce9-2b7c0c3e451b'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761444b2-f6c8-4d09-9d0f-89e739baf8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761444b2-f6c8-4d09-9d0f-89e739baf8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403f6e9c-41e1-4d20-b632-2ace10a9c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:44 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Volume b86f6a0e-4419-44ad-ad1d-13db2519694d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b86f6a0e-4419-44ad-ad1d-13db2519694d', 'volume_size': 2, 'snapshot_id': '7b034f4f-731c-4167-8ce9-2b7c0c3e451b'} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-7b034f4f-731c-4167-8ce9-2b7c0c3e451b-b86f6a0e-4419-44ad-ad1d-13db2519694d" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7b034f4f-731c-4167-8ce9-2b7c0c3e451b-b86f6a0e-4419-44ad-ad1d-13db2519694d" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Creating volume b86f6a0e-4419-44ad-ad1d-13db2519694d from snapshot 7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-b86f6a0e-4419-44ad-ad1d-13db2519694d" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b86f6a0e-4419-44ad-ad1d-13db2519694d" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] snapshot: 7b034f4f-731c-4167-8ce9-2b7c0c3e451b, volume: b86f6a0e-4419-44ad-ad1d-13db2519694d, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e51b7d-aa56-422f-b11c-db6da23846c3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['6eaa9d7c-3367-4f19-948c-c2f41a8d914e', '1c7a10f1-cbfa-4512-9697-902431a76b0f', '8c06db08-ad51-4711-8f6b-a2e743cba155', 'b3a4f992-ffef-461a-8e56-b9036ec913f6'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:45 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b Sep 28 15:13:45 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b1532b5e-3fcb-40ce-a2ab-d855b7588fcd tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0ddb02b1-1396-4fa3-9f31-dc49454f35fa: deleted successfully Sep 28 15:13:45 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b" returned: 0 in 0.480s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51a81da-89cd-4e31-84be-350ca1b60db1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:45 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:13:45 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:46 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.527s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:46 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:13:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:46 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d Sep 28 15:13:46 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-0a590486-2277-4cec-ac03-7e73a6b3ee9f" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-0a590486-2277-4cec-ac03-7e73a6b3ee9f" acquired by "delete_volume" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:47 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b89c07-c695-4022-8be3-4f6b9ba0122f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:47 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f Sep 28 15:13:47 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:47 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f" returned: 0 in 0.922s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:48 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f Sep 28 15:13:48 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:48 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0a590486-2277-4cec-ac03-7e73a6b3ee9f" returned: 0 in 0.770s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-0a590486-2277-4cec-ac03-7e73a6b3ee9f" released by "delete_volume" :: held 1.888s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-4d57eefb-4a43-474f-bc0a-dc2c33508be0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-4d57eefb-4a43-474f-bc0a-dc2c33508be0" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8ae9f-1444-4cea-8637-a08f68383a90]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:49 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 Sep 28 15:13:49 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:49 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0" returned: 0 in 0.859s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:49 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0 Sep 28 15:13:49 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:50 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4d57eefb-4a43-474f-bc0a-dc2c33508be0" returned: 0 in 0.580s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-4d57eefb-4a43-474f-bc0a-dc2c33508be0" released by "delete_volume" :: held 1.619s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:50 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['2f14d51f-3ca1-4625-8d0d-df0fd9aa242e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:50 devstack cinder-volume[86888]: WARNING cinder.quota [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-958233491 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-958233491, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:13:50 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['d0c4e200-9c3d-4131-9e99-d38afc193c34', 'a38b60b4-c86d-48a7-9e20-f380b1030655', '8073b3e4-4c7f-4f1a-ba07-4d67ce6ea2b3', '0118977a-c3fe-4670-bc03-d18f2d48fd51'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['39673522-7eec-40d0-bb07-9d8fc6ae2b4c', '920b13b5-3423-4b59-a994-196d0c601c24', '177ec697-d62b-4c25-a2b6-04a7b6570d25', '1309b190-f202-4f51-afa9-a249386580c9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:51 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:13:51 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:52 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.058s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:52 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6c10a1da-d024-403a-8468-4604c9405636 tempest-GroupSnapshotsTest-2110138437 None] Delete group completed successfully. Sep 28 15:13:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e7195f2d-eb82-41d6-b8f1-be4e319dfaf2 tempest-GroupSnapshotsTest-2110138437 None] Group tempest-GroupSnapshotsTest-Group-1247565614: creating Sep 28 15:13:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e7195f2d-eb82-41d6-b8f1-be4e319dfaf2 tempest-GroupSnapshotsTest-2110138437 None] Group tempest-GroupSnapshotsTest-Group-1247565614: created successfully Sep 28 15:13:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e7195f2d-eb82-41d6-b8f1-be4e319dfaf2 tempest-GroupSnapshotsTest-2110138437 None] Create group completed successfully. Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (acfff9bd-6338-4470-ab7a-ed8c3259a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b758be37-2660-403e-b3be-f571f76a6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b758be37-2660-403e-b3be-f571f76a6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-32122240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b9c4cc1-d017-49a7-ab16-987814801c9f,host='devstack@QuobyteHD#QuobyteHD',id=c4c380e7-03f9-4db1-ac9c-0c6d219e01eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:57Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49caa1be-6cf1-43f7-ad87-0f43807d8824),volume_type_id=49caa1be-6cf1-43f7-ad87-0f43807d8824)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6967b026-28b3-4642-b787-1d975a1d3bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6967b026-28b3-4642-b787-1d975a1d3bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77f73e2-2ad2-4245-9d92-98cbe02731b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77f73e2-2ad2-4245-9d92-98cbe02731b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c380e7-03f9-4db1-ac9c-0c6d219e01eb', 'volume_name': 'volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01523e4e-2dff-4438-a34e-c107f5b1d8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01523e4e-2dff-4438-a34e-c107f5b1d8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c389846-4b96-4380-9ce9-5f4ae5823f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:57 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Volume c4c380e7-03f9-4db1-ac9c-0c6d219e01eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb', 'volume_size': 1} Sep 28 15:13:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:58 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d" returned: 0 in 12.458s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:58 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ffe5b-f168-4bab-b25b-b87d94eef707]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:58 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:13:58 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:59 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.773s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2, size 1024.00 MB, duration 12.46 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:13:59 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Converted 1024.00 MB image at 82.19 MB/s Sep 28 15:13:59 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d is being set with open permissions: ugo+rw Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:59 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d Sep 28 15:13:59 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:59 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d" returned: 0 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b86f6a0e-4419-44ad-ad1d-13db2519694d" released by "_copy_volume_from_snapshot" :: held 14.909s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7b034f4f-731c-4167-8ce9-2b7c0c3e451b-b86f6a0e-4419-44ad-ad1d-13db2519694d" released by "_create_volume_from_snapshot" :: held 15.023s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.087s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.368s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b9c4cc1-d017-49a7-ab16-987814801c9f,created_at=2026-09-28T13:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-32122240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b9c4cc1-d017-49a7-ab16-987814801c9f,host='devstack@QuobyteHD#QuobyteHD',id=c4c380e7-03f9-4db1-ac9c-0c6d219e01eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685e5383b30d494995b5f4c36ec3034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:57Z,use_quota=True,user_id='9ed8a426c7ae4ae785610ee6ed5f3f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49caa1be-6cf1-43f7-ad87-0f43807d8824),volume_type_id=49caa1be-6cf1-43f7-ad87-0f43807d8824)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Creating volume c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:13:59 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403f6e9c-41e1-4d20-b632-2ace10a9c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86f6a0e-4419-44ad-ad1d-13db2519694d', 'volume_size': 2, 'snapshot_id': '7b034f4f-731c-4167-8ce9-2b7c0c3e451b'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:59 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb 1073741824 Sep 28 15:13:59 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440fbc37-f131-4993-b17d-2f9df5977a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:59 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Volume volume-b86f6a0e-4419-44ad-ad1d-13db2519694d (b86f6a0e-4419-44ad-ad1d-13db2519694d): created successfully Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440fbc37-f131-4993-b17d-2f9df5977a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (00c89a85-459d-437c-a884-ca56cd299e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f2e11eef-e4d1-4afd-b58e-7fa75cfc3bac tempest-VolumesSnapshotTestJSON-816067968 None] Created volume successfully. Sep 28 15:14:00 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb 1073741824" returned: 0 in 0.863s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:00 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb Sep 28 15:14:00 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-b86f6a0e-4419-44ad-ad1d-13db2519694d-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-b86f6a0e-4419-44ad-ad1d-13db2519694d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-b86f6a0e-4419-44ad-ad1d-13db2519694d" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b86f6a0e-4419-44ad-ad1d-13db2519694d" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc02b42d-e528-4c3b-b185-9f38ad700fe1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" returned: 0 in 0.456s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c389846-4b96-4380-9ce9-5f4ae5823f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bcef84-f12e-4770-83f6-d5f39181d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:01 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d Sep 28 15:14:01 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Volume volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb (c4c380e7-03f9-4db1-ac9c-0c6d219e01eb): created successfully Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bcef84-f12e-4770-83f6-d5f39181d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Flow 'volume_create_manager' (acfff9bd-6338-4470-ab7a-ed8c3259a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e5693a73-7c6c-46d1-9827-a4e0d584bf3f tempest-GroupSnapshotsTest-2110138437 None] Created volume successfully. Sep 28 15:14:01 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d" returned: 0 in 0.476s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:01 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d Sep 28 15:14:01 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b86f6a0e-4419-44ad-ad1d-13db2519694d" returned: 0 in 0.329s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b86f6a0e-4419-44ad-ad1d-13db2519694d" released by "delete_volume" :: held 0.897s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['7de7ce53-239d-4e50-8262-383f484a713f', '08667932-9290-41bd-91e3-468c83b16869', '99fe5784-97d0-4703-bc23-c089c69a2938', 'ec7985de-21ee-4c09-9ee0-d0fabcd34128'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:02 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:02 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-7b034f4f-731c-4167-8ce9-2b7c0c3e451b-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-7b034f4f-731c-4167-8ce9-2b7c0c3e451b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.196s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-80f1e858-d585-4ba4-92ec-5a76feb23bf2" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-80f1e858-d585-4ba4-92ec-5a76feb23bf2" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-7b034f4f-731c-4167-8ce9-2b7c0c3e451b" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (454e3ac2-e75e-42fd-af98-399300df835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e528cee-6f56-4221-8580-128ca25c08b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:02 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.488s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7b034f4f-731c-4167-8ce9-2b7c0c3e451b" acquired by "_delete_snapshot" :: waited 0.128s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Deleting offline snapshot 7b034f4f-731c-4167-8ce9-2b7c0c3e451b of volume 80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] snapshot_file for this snap is: volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Deleted volume successfully. Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2d9fa1-8b17-4b19-9a80-e82e83b8cdcc]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e528cee-6f56-4221-8580-128ca25c08b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733307812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db86ad65-6c63-49d8-bedb-37e20bb58300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:03Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188d2aff-12a8-4d1f-a206-a0c0b12f23c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188d2aff-12a8-4d1f-a206-a0c0b12f23c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c5c045-a0b3-4028-8d55-586d12023821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c5c045-a0b3-4028-8d55-586d12023821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db86ad65-6c63-49d8-bedb-37e20bb58300', 'volume_name': 'volume-db86ad65-6c63-49d8-bedb-37e20bb58300', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f68c28-32c5-4454-a9a9-46cf7b452f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f68c28-32c5-4454-a9a9-46cf7b452f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119103db-ba09-463b-b0d3-1fb42228ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:02 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Volume db86ad65-6c63-49d8-bedb-37e20bb58300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db86ad65-6c63-49d8-bedb-37e20bb58300', 'volume_size': 1} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733307812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db86ad65-6c63-49d8-bedb-37e20bb58300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:03Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Creating volume db86ad65-6c63-49d8-bedb-37e20bb58300 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:14:02 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:03 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 1073741824 Sep 28 15:14:03 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e0506e71-1b4c-410d-953a-0f3a996f0932 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-b86f6a0e-4419-44ad-ad1d-13db2519694d-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:03 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b Sep 28 15:14:03 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] GroupSnapshot 0cc502fd-bb4c-42d3-9705-e2cc3d79b449: creating. Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Group snapshot 0cc502fd-bb4c-42d3-9705-e2cc3d79b449: creating. {{(pid=86888) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:03 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b" returned: 0 in 0.583s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[860bc500-9381-477b-bd3b-80f196560ef8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:03 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 1073741824" returned: 0 in 0.762s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:03 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:14:03 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:03 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 Sep 28 15:14:03 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:04 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300" returned: 0 in 0.295s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.778s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119103db-ba09-463b-b0d3-1fb42228ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db86ad65-6c63-49d8-bedb-37e20bb58300', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75c90fd-67f1-4795-a2fe-97ba3067c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Creating offline snapshot 79347e45-7d50-48ce-8831-8e07f701fb33 of volume c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:14:04 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.550s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:04 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Volume volume-db86ad65-6c63-49d8-bedb-37e20bb58300 (db86ad65-6c63-49d8-bedb-37e20bb58300): created successfully Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75c90fd-67f1-4795-a2fe-97ba3067c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:04 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b Sep 28 15:14:04 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (454e3ac2-e75e-42fd-af98-399300df835d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5744bd99-aeb7-4925-8398-4bd1064183f5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c1a1e4a1-e542-44a9-9b12-e6e399143df7 tempest-ProjectReaderTests-1264263757 None] Created volume successfully. Sep 28 15:14:04 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb Sep 28 15:14:04 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:04 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b" returned: 0 in 0.590s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:04 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b Sep 28 15:14:04 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:04 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" returned: 0 in 0.617s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:04 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 1G Sep 28 15:14:04 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-db86ad65-6c63-49d8-bedb-37e20bb58300-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Lock "cinder-db86ad65-6c63-49d8-bedb-37e20bb58300-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-quobyte-db86ad65-6c63-49d8-bedb-37e20bb58300" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-db86ad65-6c63-49d8-bedb-37e20bb58300" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072bb68-192c-495a-b19d-62fd90865cac]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2.7b034f4f-731c-4167-8ce9-2b7c0c3e451b" returned: 0 in 0.490s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7b034f4f-731c-4167-8ce9-2b7c0c3e451b" released by "_delete_snapshot" :: held 2.475s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-80f1e858-d585-4ba4-92ec-5a76feb23bf2" released by "delete_snapshot" :: held 2.618s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:05 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 Sep 28 15:14:05 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['6c209927-5f26-4e9a-b91a-042c72d49642', '87befd35-fa44-4e62-8b7c-ea0bfbf128c6', 'ae465619-838c-4c2f-83d9-d8087a481876', 'ff43c782-e065-4e46-b582-8de68a0fff47'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:05 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Delete snapshot completed successfully. Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c19398e-25b5-403b-95c2-90b0e00844b6 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-7b034f4f-731c-4167-8ce9-2b7c0c3e451b-delete_snapshot" released by "delete_snapshot" :: held 2.952s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:05 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 1G" returned: 0 in 0.762s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 Sep 28 15:14:05 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-80f1e858-d585-4ba4-92ec-5a76feb23bf2-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300" returned: 0 in 0.666s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-80f1e858-d585-4ba4-92ec-5a76feb23bf2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:05 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300 Sep 28 15:14:05 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-80f1e858-d585-4ba4-92ec-5a76feb23bf2" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-80f1e858-d585-4ba4-92ec-5a76feb23bf2" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[10777c35-a9bc-446e-83d0-69aa814f816c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33" returned: 0 in 0.488s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 Sep 28 15:14:06 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:14:06 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-db86ad65-6c63-49d8-bedb-37e20bb58300" returned: 0 in 0.453s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-db86ad65-6c63-49d8-bedb-37e20bb58300" released by "delete_volume" :: held 1.197s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Created reservations ['73b8198e-a3ad-4546-bf8e-320e6b9c7e3a', 'b2ed34c5-9a4d-4b30-8f70-06306a67d54f', 'b182a978-35f0-4fa5-a5dc-f493f49732c0', 'd47a6c10-4057-4f1a-a2e2-af7e1bd10d76'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:06 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33" returned: 0 in 0.395s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:06 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.564s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:06 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info Sep 28 15:14:06 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2 Sep 28 15:14:06 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:06 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.370s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:06 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Deleted volume successfully. Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-80f1e858-d585-4ba4-92ec-5a76feb23bf2" returned: 0 in 0.338s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=173,cinder:UPDATE=186,cinder:INSERT=47,cinder:DELETE=9 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-80f1e858-d585-4ba4-92ec-5a76feb23bf2" released by "delete_volume" :: held 1.036s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=158,cinder:UPDATE=160,cinder:INSERT=38,cinder:DELETE=9 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-80e980af-8e2b-4a13-87c9-091f37b611bd tempest-ProjectReaderTests-1264263757 None] Lock "cinder-db86ad65-6c63-49d8-bedb-37e20bb58300-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:07 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info" returned: 0 in 0.468s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:07 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info Sep 28 15:14:07 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['8440c3c8-f586-44c2-aafa-ce58af26d0e8', 'f1d9dc0a-8c60-450f-bbd8-03ac3e03eeff', 'c4f92633-df2f-4a40-a55f-6a8bae27442d', 'e351fed6-5d9b-4d8f-90af-1e8a792c9a18'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:07 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:07 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:07 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.info" returned: 0 in 0.337s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-582b9852-ffbc-48a7-8dd4-fee4d93c480b tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0cc502fd-bb4c-42d3-9705-e2cc3d79b449: created successfully Sep 28 15:14:07 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.341s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Deleted volume successfully. Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee39bec0-654e-4ba2-8902-b35b8af9d0e8 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-80f1e858-d585-4ba4-92ec-5a76feb23bf2-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0cc502fd-bb4c-42d3-9705-e2cc3d79b449: deleting Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0cc502fd-bb4c-42d3-9705-e2cc3d79b449: deleting {{(pid=86888) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-79347e45-7d50-48ce-8831-8e07f701fb33" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-79347e45-7d50-48ce-8831-8e07f701fb33" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Deleting offline snapshot 79347e45-7d50-48ce-8831-8e07f701fb33 of volume c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] snapshot_file for this snap is: volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edbf4fc-24a5-4924-892e-7b329761734f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (e1ed936e-5e78-4253-a864-e0518934981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ba859d-6198-4cb1-b07e-1f1ffee120b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:08 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 Sep 28 15:14:08 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ba859d-6198-4cb1-b07e-1f1ffee120b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311873370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43af7a4b-6445-4c6c-a232-05770820a9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:08Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b90666-826e-4659-9be1-d75918c31d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b90666-826e-4659-9be1-d75918c31d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93875db2-c727-48c9-8aa0-dc4368b64cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93875db2-c727-48c9-8aa0-dc4368b64cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43af7a4b-6445-4c6c-a232-05770820a9c1', 'volume_name': 'volume-43af7a4b-6445-4c6c-a232-05770820a9c1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602c734-6fb5-4451-857a-9148e4d3f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602c734-6fb5-4451-857a-9148e4d3f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4d0fac-ed04-40de-8c02-5a2b098e3bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Volume 43af7a4b-6445-4c6c-a232-05770820a9c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43af7a4b-6445-4c6c-a232-05770820a9c1', 'volume_size': 1} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311873370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43af7a4b-6445-4c6c-a232-05770820a9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:08Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Creating volume 43af7a4b-6445-4c6c-a232-05770820a9c1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:14:08 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:08 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 1073741824 Sep 28 15:14:08 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:08 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33" returned: 0 in 0.528s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a500c8-ea55-4925-8fd4-62bd26f6a550]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:08 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb Sep 28 15:14:08 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:09 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 1073741824" returned: 0 in 0.779s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (c56196d4-77fb-4ab4-943f-0a81f6721c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2fff74-306a-4243-b4a3-779df818d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2fff74-306a-4243-b4a3-779df818d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875848391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:09Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf1b3c9-9e5b-4fb6-9cd7-068339774be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf1b3c9-9e5b-4fb6-9cd7-068339774be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f11e6a6-7d4e-4829-9331-bcc2fb09351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f11e6a6-7d4e-4829-9331-bcc2fb09351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b', 'volume_name': 'volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7a37b3-d5f6-4d37-8e92-32ecad81b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7a37b3-d5f6-4d37-8e92-32ecad81b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15fd51e-d9cf-4041-b73e-db5e39d4408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Volume 7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b', 'volume_size': 1} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" returned: 0 in 0.622s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 Sep 28 15:14:09 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:09 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 Sep 28 15:14:09 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:09 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1" returned: 0 in 0.324s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875848391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:09Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Creating volume 7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:14:09 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b 1073741824 Sep 28 15:14:09 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4d0fac-ed04-40de-8c02-5a2b098e3bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43af7a4b-6445-4c6c-a232-05770820a9c1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8934230f-1abf-4043-b68d-d40a3a9dc463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Volume volume-43af7a4b-6445-4c6c-a232-05770820a9c1 (43af7a4b-6445-4c6c-a232-05770820a9c1): created successfully Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8934230f-1abf-4043-b68d-d40a3a9dc463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (e1ed936e-5e78-4253-a864-e0518934981f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d5427abb-6737-451a-9bf9-29d25c07e65f tempest-ProjectReaderTests-1264263757 None] Created volume successfully. Sep 28 15:14:09 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33" returned: 0 in 0.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33 Sep 28 15:14:09 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb.79347e45-7d50-48ce-8831-8e07f701fb33" returned: 0 in 0.409s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-79347e45-7d50-48ce-8831-8e07f701fb33" released by "_delete_snapshot" :: held 2.234s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" released by "delete_snapshot" :: held 2.276s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:10 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b 1073741824" returned: 0 in 0.676s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-43af7a4b-6445-4c6c-a232-05770820a9c1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Lock "cinder-43af7a4b-6445-4c6c-a232-05770820a9c1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:10 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:10 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack cinder-volume[86888]: WARNING cinder.quota [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-586708573 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-586708573, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:10 devstack cinder-volume[86888]: WARNING cinder.quota [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-586708573 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-586708573, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-quobyte-43af7a4b-6445-4c6c-a232-05770820a9c1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-43af7a4b-6445-4c6c-a232-05770820a9c1" acquired by "delete_volume" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['7b08de03-69e5-4a5b-8854-e58b158ca867', '2645c2f2-dfd0-4079-9b88-d3dafb6541c7', 'b1324f17-c0ec-438d-b52a-0c0226a60de2', '3fe0e58e-5324-49d6-bf00-27ebb1b5d738'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d361cd-519c-47ca-bcda-fe8e674ba7e8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ba3e2880-a664-46b9-bdd0-58b55734a28e tempest-GroupSnapshotsTest-2110138437 None] group_snapshot 0cc502fd-bb4c-42d3-9705-e2cc3d79b449: deleted successfully Sep 28 15:14:10 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 Sep 28 15:14:10 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.375s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15fd51e-d9cf-4041-b73e-db5e39d4408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd2e213-509f-4dfd-890e-b73cd4146697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Volume volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b (7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b): created successfully Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd2e213-509f-4dfd-890e-b73cd4146697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (c56196d4-77fb-4ab4-943f-0a81f6721c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7d5bc8e3-baef-45eb-bae1-6579957304b1 tempest-VolumesSnapshotTestJSON-816067968 None] Created volume successfully. Sep 28 15:14:11 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1" returned: 0 in 0.546s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:11 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1 Sep 28 15:14:11 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Creating offline snapshot 8478e295-dba8-4f1b-9802-8ba9d0e1a5ad of volume 7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3763f828-88f1-4fbb-bf85-80b5f986d1e3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:11 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-43af7a4b-6445-4c6c-a232-05770820a9c1" returned: 0 in 0.442s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-43af7a4b-6445-4c6c-a232-05770820a9c1" released by "delete_volume" :: held 1.066s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:11 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:11 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Created reservations ['cbede865-6db2-4695-b2cd-e259325d0393', '4340faaa-672d-41ca-88ce-780fcfcd7ded', '58ad15b2-f9fc-4b48-b676-ae0ef4ddabe8', 'c5db4f7a-2336-4466-9720-aa73a3ae7067'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:11 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:11 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "cinder-quobyte-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" acquired by "delete_volume" :: waited 0.049s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e73016-7a80-4a0e-a281-686324b7f3cf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.776s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad 1G Sep 28 15:14:12 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.520s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Deleted volume successfully. Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-78f76aeb-2b07-44ef-83c0-ac00273fa58d tempest-ProjectReaderTests-1264263757 None] Lock "cinder-43af7a4b-6445-4c6c-a232-05770820a9c1-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:12 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb Sep 28 15:14:12 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Acquiring lock "cinder-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Lock "cinder-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:12 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" returned: 0 in 0.573s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb Sep 28 15:14:12 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Acquiring lock "cinder-quobyte-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Lock "cinder-quobyte-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf0875-805b-440f-9ecf-17a75fc0b9bf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad 1G" returned: 0 in 0.776s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:12 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad Sep 28 15:14:12 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 Sep 28 15:14:13 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Lock "cinder-quobyte-c4c380e7-03f9-4db1-ac9c-0c6d219e01eb" released by "delete_volume" :: held 1.131s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['4f193da6-14f2-4ec3-b8b7-77a5433c0d5f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:13 devstack cinder-volume[86888]: WARNING cinder.quota [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-586708573 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-586708573, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Created reservations ['9efd495d-1257-430c-88e8-7ca623e0bd37', '33986905-51aa-481f-aec8-0764dcc7804c', 'a4d6ac82-7f0c-4a0d-8d87-0549d66eb9c6', '1eecba6e-28f4-4c9f-ae2a-5295cbc7e42b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:13 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7" returned: 0 in 0.662s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:13 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" returned: 0 in 0.585s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad is being set with open permissions: ugo+rw Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:13 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7 Sep 28 15:14:13 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad Sep 28 15:14:13 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (7d2cb399-02a4-47ab-a2ee-ac8fe6b4087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920f4788-d7ba-4d69-95c8-9b230b1207b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920f4788-d7ba-4d69-95c8-9b230b1207b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513628372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba52932-6b5f-466c-99a0-29f622dd5387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:13Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e521a595-bea3-4840-af79-6b2cdf50dca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e521a595-bea3-4840-af79-6b2cdf50dca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7e7b63-d69b-4751-9bf8-daefed6adf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7e7b63-d69b-4751-9bf8-daefed6adf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba52932-6b5f-466c-99a0-29f622dd5387', 'volume_name': 'volume-fba52932-6b5f-466c-99a0-29f622dd5387', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae393116-528f-455b-985a-2f46d53255c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae393116-528f-455b-985a-2f46d53255c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d008283a-fdb3-455d-8d85-10a77fb58928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:13 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Volume fba52932-6b5f-466c-99a0-29f622dd5387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba52932-6b5f-466c-99a0-29f622dd5387', 'volume_size': 1} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:13 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:13 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:13 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" returned: 0 in 0.380s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Lock "cinder-quobyte-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7" released by "delete_volume" :: held 1.167s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info Sep 28 15:14:14 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Created reservations ['f8f2f31b-9bbc-4eec-84de-ee15320edf94', '5b29b05d-83b7-47e3-8e7a-880db6bff8f9', 'a2a48719-c56f-4238-81db-4138f601824e', '96453ed6-8768-4d36-b8b7-6babf8f674e1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.429s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:14 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:14 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-75d0ac70-b89e-4b0f-a7ee-5850ddcbe442 tempest-GroupSnapshotsTest-2110138437 None] Delete group completed successfully. Sep 28 15:14:14 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info" returned: 0 in 0.435s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info is being set with open permissions: ugo+rw Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info Sep 28 15:14:14 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:14 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Deleted volume successfully. Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-643dd92f-ecfd-4a3a-8c12-0f00a38f301a tempest-VolumesNegativeTest-36951724 None] Lock "cinder-c76160c8-3f81-4cc4-978b-fbc58f0e3dc7-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:14 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.info" returned: 0 in 0.359s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.498s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513628372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba52932-6b5f-466c-99a0-29f622dd5387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:13Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Creating volume fba52932-6b5f-466c-99a0-29f622dd5387 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:14:14 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:14:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:14 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 1073741824 Sep 28 15:14:14 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1295b99f-ddaf-4f3b-8ffb-0c97cc277cb3 tempest-VolumesSnapshotTestJSON-816067968 None] Create snapshot completed successfully Sep 28 15:14:15 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 1073741824" returned: 0 in 0.750s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:15 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 Sep 28 15:14:15 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:16 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387" returned: 0 in 0.395s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d008283a-fdb3-455d-8d85-10a77fb58928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba52932-6b5f-466c-99a0-29f622dd5387', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612cd5ee-446b-4418-b1f7-ccef48488478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Volume volume-fba52932-6b5f-466c-99a0-29f622dd5387 (fba52932-6b5f-466c-99a0-29f622dd5387): created successfully Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612cd5ee-446b-4418-b1f7-ccef48488478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (7d2cb399-02a4-47ab-a2ee-ac8fe6b4087c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a7456d91-a85e-47de-99a5-842aae8b9a76 tempest-ProjectReaderTests-1264263757 None] Created volume successfully. Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (10201412-d186-43a7-aae6-14f9cc1dcaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b2007e-1043-4a81-a76d-b38860c67907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b2007e-1043-4a81-a76d-b38860c67907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-485038293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc36d804-a4d1-4f17-8510-fbe5943025f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8dc0dec5964c6f976933ed15be7b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8478e295-dba8-4f1b-9802-8ba9d0e1a5ad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:16Z,use_quota=True,user_id='9689f5693c594969ae4253cd5ef80126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd025448-8ba4-4082-8a50-331a9b427371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd025448-8ba4-4082-8a50-331a9b427371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a7faf2-2d92-43aa-b56d-5ab1f0345fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a7faf2-2d92-43aa-b56d-5ab1f0345fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc36d804-a4d1-4f17-8510-fbe5943025f0', 'volume_name': 'volume-fc36d804-a4d1-4f17-8510-fbe5943025f0', 'volume_size': 1, 'snapshot_id': '8478e295-dba8-4f1b-9802-8ba9d0e1a5ad'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed19a8f-bfb8-4f69-aaa1-0bc0f9ab9ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed19a8f-bfb8-4f69-aaa1-0bc0f9ab9ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2051e983-f99f-43c7-af50-6630794670a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:16 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Volume fc36d804-a4d1-4f17-8510-fbe5943025f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc36d804-a4d1-4f17-8510-fbe5943025f0', 'volume_size': 1, 'snapshot_id': '8478e295-dba8-4f1b-9802-8ba9d0e1a5ad'} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-fba52932-6b5f-466c-99a0-29f622dd5387-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad-fc36d804-a4d1-4f17-8510-fbe5943025f0" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-fba52932-6b5f-466c-99a0-29f622dd5387-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad-fc36d804-a4d1-4f17-8510-fbe5943025f0" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Creating volume fc36d804-a4d1-4f17-8510-fbe5943025f0 from snapshot 8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-fc36d804-a4d1-4f17-8510-fbe5943025f0" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-fc36d804-a4d1-4f17-8510-fbe5943025f0" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] snapshot: 8478e295-dba8-4f1b-9802-8ba9d0e1a5ad, volume: fc36d804-a4d1-4f17-8510-fbe5943025f0, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-quobyte-fba52932-6b5f-466c-99a0-29f622dd5387" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dfa2d6-6dfc-4716-8d6e-70d834cd6bb2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-fba52932-6b5f-466c-99a0-29f622dd5387" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b5beda-73de-46ed-8339-6fd38b34dfa8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad Sep 28 15:14:17 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:17 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 Sep 28 15:14:17 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:17 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" returned: 0 in 0.641s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[47983c9f-6fdf-4e5b-9989-49bf0d45bcfe]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387" returned: 0 in 0.758s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:17 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:17 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387 Sep 28 15:14:17 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:18 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:18 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fba52932-6b5f-466c-99a0-29f622dd5387" returned: 0 in 0.514s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.737s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-fba52932-6b5f-466c-99a0-29f622dd5387" released by "delete_volume" :: held 1.406s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:18 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 Sep 28 15:14:18 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Created reservations ['5b4a6ccd-502f-4281-9910-1a1f6c14bd40', '67dfce92-e872-4cd7-88a3-418d36eb4776', '7d604c2e-cae0-4f7b-ae4a-36556bf15030', '48119452-bf58-40f8-948a-713f58bff36e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:18 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:18 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:19 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.502s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:19 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Deleted volume successfully. Sep 28 15:14:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-124fafa9-3b8f-44ee-a8de-647252a422c2 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-fba52932-6b5f-466c-99a0-29f622dd5387-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (c84d5980-800d-436b-a753-f285eef0f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad63087-1258-4f7b-963f-d70887612bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad63087-1258-4f7b-963f-d70887612bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435902281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f43861-234a-4b34-8a26-542da1cc74fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:20Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a001ad8-45c3-4ca1-b133-523dc49d643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a001ad8-45c3-4ca1-b133-523dc49d643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1782ba33-0046-4112-894f-67b1182abc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1782ba33-0046-4112-894f-67b1182abc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f43861-234a-4b34-8a26-542da1cc74fa', 'volume_name': 'volume-f8f43861-234a-4b34-8a26-542da1cc74fa', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc76016e-c010-491f-abb4-1c2004101203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc76016e-c010-491f-abb4-1c2004101203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4ea60d-737c-49e9-a0e3-6305b2bf3e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:20 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Volume f8f43861-234a-4b34-8a26-542da1cc74fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f43861-234a-4b34-8a26-542da1cc74fa', 'volume_size': 1} Sep 28 15:14:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:29 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0" returned: 0 in 10.614s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b823a7d5-5fab-4fb0-a961-4b9541bdb85b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:29 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:29 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:29 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.727s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:29 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b, size 1024.00 MB, duration 10.62 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:14:29 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Converted 1024.00 MB image at 96.46 MB/s Sep 28 15:14:29 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 is being set with open permissions: ugo+rw Sep 28 15:14:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:29 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 Sep 28 15:14:29 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:30 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0" returned: 0 in 0.427s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-fc36d804-a4d1-4f17-8510-fbe5943025f0" released by "_copy_volume_from_snapshot" :: held 13.311s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad-fc36d804-a4d1-4f17-8510-fbe5943025f0" released by "_create_volume_from_snapshot" :: held 13.374s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.419s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.519s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435902281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f43861-234a-4b34-8a26-542da1cc74fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2d5d82bad48b49ce1e45a92309f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:20Z,use_quota=True,user_id='09c63305e35742a1b2642021c1f2c803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Creating volume f8f43861-234a-4b34-8a26-542da1cc74fa {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:14:30 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:30 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa 1073741824 Sep 28 15:14:30 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2051e983-f99f-43c7-af50-6630794670a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc36d804-a4d1-4f17-8510-fbe5943025f0', 'volume_size': 1, 'snapshot_id': '8478e295-dba8-4f1b-9802-8ba9d0e1a5ad'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a82b7b5-71cc-4696-893d-7b1dcec932d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:30 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Volume volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 (fc36d804-a4d1-4f17-8510-fbe5943025f0): created successfully Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a82b7b5-71cc-4696-893d-7b1dcec932d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Flow 'volume_create_manager' (10201412-d186-43a7-aae6-14f9cc1dcaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-41f33213-de81-44ca-9b00-6d12e71f080c tempest-VolumesSnapshotTestJSON-816067968 None] Created volume successfully. Sep 28 15:14:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-fc36d804-a4d1-4f17-8510-fbe5943025f0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-fc36d804-a4d1-4f17-8510-fbe5943025f0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-fc36d804-a4d1-4f17-8510-fbe5943025f0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-fc36d804-a4d1-4f17-8510-fbe5943025f0" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c78e13-5653-4723-93eb-9f4cd397b43e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:31 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa 1073741824" returned: 0 in 0.862s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:31 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa Sep 28 15:14:31 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:31 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 Sep 28 15:14:31 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:31 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa" returned: 0 in 0.477s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4ea60d-737c-49e9-a0e3-6305b2bf3e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f43861-234a-4b34-8a26-542da1cc74fa', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb34c4ec-1c36-4244-beba-039f4bc33cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Volume volume-f8f43861-234a-4b34-8a26-542da1cc74fa (f8f43861-234a-4b34-8a26-542da1cc74fa): created successfully Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb34c4ec-1c36-4244-beba-039f4bc33cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Flow 'volume_create_manager' (c84d5980-800d-436b-a753-f285eef0f80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:31 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1689b1a3-83d9-4275-afb6-f3cefe45bcd4 tempest-ProjectReaderTests-1264263757 None] Created volume successfully. Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0" returned: 0 in 0.663s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:31 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0 Sep 28 15:14:31 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-f8f43861-234a-4b34-8a26-542da1cc74fa-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-f8f43861-234a-4b34-8a26-542da1cc74fa-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "cinder-quobyte-f8f43861-234a-4b34-8a26-542da1cc74fa" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:32 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc36d804-a4d1-4f17-8510-fbe5943025f0" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-f8f43861-234a-4b34-8a26-542da1cc74fa" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-fc36d804-a4d1-4f17-8510-fbe5943025f0" released by "delete_volume" :: held 1.207s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd86a92-1147-4cc0-9263-fe7424bb0ba6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['0b42f30b-0df6-47dc-a63b-bdda3f8c060d', '631492b1-0172-4221-babe-d8cce36df786', '434e2f76-3abf-4862-b8b7-a930a0beaef5', 'e1c825c8-4d81-4acd-9067-3427c3b85cfc'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:32 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa Sep 28 15:14:32 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:32 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:32 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:33 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa" returned: 0 in 0.706s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa Sep 28 15:14:33 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:33 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.580s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Deleted volume successfully. Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-883d96ec-dd42-414d-9aa2-c2cad1a684c3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-fc36d804-a4d1-4f17-8510-fbe5943025f0-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:33 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8f43861-234a-4b34-8a26-542da1cc74fa" returned: 0 in 0.510s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-quobyte-f8f43861-234a-4b34-8a26-542da1cc74fa" released by "delete_volume" :: held 1.293s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Deleting offline snapshot 8478e295-dba8-4f1b-9802-8ba9d0e1a5ad of volume 7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] snapshot_file for this snap is: volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff9dd7-ed0d-4175-a618-ecfdd111d3e7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Created reservations ['08f519a0-5398-42ba-ae3c-8581469a000d', '63d8fe09-81a9-40e8-8f24-cf3319536385', '6ae4f683-b583-4b8d-bec9-c4399bfd913e', '9e330757-d3a7-4910-81bd-55e03cbfcac3'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:33 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad Sep 28 15:14:33 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:33 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:34 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" returned: 0 in 0.652s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:34 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.460s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Deleted volume successfully. Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db00589-ccab-4ee8-95d1-41ce283b50a2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-48e9c7d8-5205-4e4a-a92c-faee6568fa70 tempest-ProjectReaderTests-1264263757 None] Lock "cinder-f8f43861-234a-4b34-8a26-542da1cc74fa-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:34 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:34 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:34 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.575s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:34 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad Sep 28 15:14:34 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:35 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" returned: 0 in 0.615s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:35 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad Sep 28 15:14:35 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:36 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b.8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" returned: 0 in 0.481s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad" released by "_delete_snapshot" :: held 2.533s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" released by "delete_snapshot" :: held 2.579s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:36 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['c5f32c4e-71ce-4431-93ea-e68e49c0fd40', 'c13f0d67-3d62-4f2a-a12c-b3d5c6d9ae3d', 'ea0fb08c-d748-4ceb-ad81-53bfb4ed7eb9', 'a6e798aa-7f84-45d5-ad6a-9f2134e34aed'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:36 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Delete snapshot completed successfully. Sep 28 15:14:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-74f2c09a-489e-4e3a-8c8a-084dd3febfc5 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-8478e295-dba8-4f1b-9802-8ba9d0e1a5ad-delete_snapshot" released by "delete_snapshot" :: held 2.895s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1aa1f-1de5-4955-829d-bbd52ef67f50]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:37 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:37 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:37 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.633s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:37 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b Sep 28 15:14:37 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:38 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" returned: 0 in 0.439s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b" released by "delete_volume" :: held 1.216s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['fc02568a-a8cd-422b-953b-47a68d934d06', 'b9fbbe40-b6b0-4300-ae4b-5925a79ee628', 'f5d53191-ece5-4412-8fc4-bd978f6ec812', '012d8891-f9b7-4b75-9fb3-6108c91cc7c2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:38 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:38 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:39 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.540s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Deleted volume successfully. Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-701441ac-c328-47fd-8f7c-aef2ba010ee3 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-7e012f58-f871-4fe4-a9bb-a2cd5bb32b6b-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-b94c3504-ee7b-4107-a7b0-550233179b81-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-b94c3504-ee7b-4107-a7b0-550233179b81-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "cinder-quobyte-b94c3504-ee7b-4107-a7b0-550233179b81" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b94c3504-ee7b-4107-a7b0-550233179b81" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ec536-8467-4c97-8ac9-4084ea0b765e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:40 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 Sep 28 15:14:40 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:40 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81" returned: 0 in 0.692s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:40 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81 Sep 28 15:14:40 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:40 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:40 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:41 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b94c3504-ee7b-4107-a7b0-550233179b81" returned: 0 in 0.760s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-quobyte-b94c3504-ee7b-4107-a7b0-550233179b81" released by "delete_volume" :: held 1.591s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:41 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.740s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Created reservations ['bff03410-bb80-4bda-8bb2-50ef5b984dd7', '32c2e977-0368-460a-8565-51c05e1128b7', '68ff4a21-47d7-44e3-b3ac-7eb1fec296fe', '388c545c-aaf0-4c68-9ba2-c63c4b959cbb'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:41 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:14:41 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:42 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.470s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:42 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Deleted volume successfully. Sep 28 15:14:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-54199729-32e9-4b5d-862a-577e49f06b61 tempest-VolumesSnapshotTestJSON-816067968 None] Lock "cinder-b94c3504-ee7b-4107-a7b0-550233179b81-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:51 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=73,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:52 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=80,cinder:INSERT=23,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Flow 'volume_create_manager' (fad0e4f2-acf8-41d9-9db1-66e3fbe76b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad3e0b2-d6c7-491a-908d-16c6ed7dba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad3e0b2-d6c7-491a-908d-16c6ed7dba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-11868356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef55742d-aa6b-43d0-96be-f76b9e3c8779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75184c1f9e0a44a7b9c6aa0f08c2fcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:00Z,use_quota=True,user_id='ace60707588b470f9fe50bb46328d022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df15ed0-5efa-4925-b2ad-2b320ca5687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df15ed0-5efa-4925-b2ad-2b320ca5687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad453ca-3f78-4603-aa25-e5b6a91eb411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad453ca-3f78-4603-aa25-e5b6a91eb411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef55742d-aa6b-43d0-96be-f76b9e3c8779', 'volume_name': 'volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc9e232-d771-40d8-88dd-90a3c2a12bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc9e232-d771-40d8-88dd-90a3c2a12bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2e595c-ab9e-411d-bcf7-bd3ed8003b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Volume ef55742d-aa6b-43d0-96be-f76b9e3c8779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779', 'volume_size': 1} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-11868356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef55742d-aa6b-43d0-96be-f76b9e3c8779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75184c1f9e0a44a7b9c6aa0f08c2fcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:00Z,use_quota=True,user_id='ace60707588b470f9fe50bb46328d022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Creating volume ef55742d-aa6b-43d0-96be-f76b9e3c8779 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:00 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:00 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 1073741824 Sep 28 15:15:00 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Flow 'volume_create_manager' (56e264a8-3a24-4bd5-b4c9-a9d1bcd53b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e3d507-00d1-47fa-84ca-9588800e5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e3d507-00d1-47fa-84ca-9588800e5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-582615868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d4f2db-9919-4db0-9dca-58b53b2292f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75184c1f9e0a44a7b9c6aa0f08c2fcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:01Z,use_quota=True,user_id='ace60707588b470f9fe50bb46328d022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5808e91e-8f57-4474-be60-adeffb005814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5808e91e-8f57-4474-be60-adeffb005814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2759c6a4-7b67-459a-a6fe-6ae86d6d0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2759c6a4-7b67-459a-a6fe-6ae86d6d0361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d4f2db-9919-4db0-9dca-58b53b2292f1', 'volume_name': 'volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e684f5-ed3f-4448-916a-cafe6486c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e684f5-ed3f-4448-916a-cafe6486c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f524a1b1-0b56-43fe-ab10-a57164eaba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:01 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Volume f8d4f2db-9919-4db0-9dca-58b53b2292f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1', 'volume_size': 1} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:01 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 1073741824" returned: 0 in 0.955s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:01 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 Sep 28 15:15:01 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779" returned: 0 in 0.474s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-582615868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d4f2db-9919-4db0-9dca-58b53b2292f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75184c1f9e0a44a7b9c6aa0f08c2fcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:01Z,use_quota=True,user_id='ace60707588b470f9fe50bb46328d022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Creating volume f8d4f2db-9919-4db0-9dca-58b53b2292f1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:02 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2e595c-ab9e-411d-bcf7-bd3ed8003b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:02 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 1073741824 Sep 28 15:15:02 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea632cda-604a-4d6a-9705-20ff93778063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:02 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Volume volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 (ef55742d-aa6b-43d0-96be-f76b9e3c8779): created successfully Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea632cda-604a-4d6a-9705-20ff93778063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Flow 'volume_create_manager' (fad0e4f2-acf8-41d9-9db1-66e3fbe76b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:02 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c15ef4c0-2c2b-4c91-bfb0-8ddc7fcb10d0 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Created volume successfully. Sep 28 15:15:03 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 1073741824" returned: 0 in 1.036s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:03 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 Sep 28 15:15:03 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:03 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f524a1b1-0b56-43fe-ab10-a57164eaba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b903882b-329e-4eac-8a86-be8b6159d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:03 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Volume volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 (f8d4f2db-9919-4db0-9dca-58b53b2292f1): created successfully Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b903882b-329e-4eac-8a86-be8b6159d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Flow 'volume_create_manager' (56e264a8-3a24-4bd5-b4c9-a9d1bcd53b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-227ae5c3-78f3-4e15-84a5-f827a9401db1 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Created volume successfully. Sep 28 15:15:13 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:13 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Flow 'volume_create_manager' (95fc3c98-d213-4a45-87f6-8b5f6ab34238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a21588c-2a76-4c2a-9885-725b10539a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a21588c-2a76-4c2a-9885-725b10539a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2082810499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0436a4abfb4856a806db3a1cb52e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:32Z,use_quota=True,user_id='60641c3772914e2e87884ae404b03f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51a0446-54f3-4223-a69e-d5a8d85030e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51a0446-54f3-4223-a69e-d5a8d85030e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d82b73-4297-4a16-baac-c6ff5cf284a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d82b73-4297-4a16-baac-c6ff5cf284a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4', 'volume_name': 'volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bb4049-48ff-47ce-a145-f0f7cd90236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bb4049-48ff-47ce-a145-f0f7cd90236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ab2e42-e65d-4cd5-a9d5-87cad6bebeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Volume 0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4', 'volume_size': 1} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2082810499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0436a4abfb4856a806db3a1cb52e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:32Z,use_quota=True,user_id='60641c3772914e2e87884ae404b03f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Creating volume 0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:32 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:32 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 1073741824 Sep 28 15:15:32 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:32 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 1073741824" returned: 0 in 0.807s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:32 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:15:32 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.336s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ab2e42-e65d-4cd5-a9d5-87cad6bebeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0a998b-08f6-4257-9296-8f6b2e7f0311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Volume volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 (0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4): created successfully Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0a998b-08f6-4257-9296-8f6b2e7f0311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Flow 'volume_create_manager' (95fc3c98-d213-4a45-87f6-8b5f6ab34238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d68061df-0cf2-4cfd-b57b-fffb376451cf tempest-SnapshotDependencyTests-304558082 None] Created volume successfully. Sep 28 15:15:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Creating offline snapshot 5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 of volume 0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cb693a-1f8e-4739-8f65-345e87999404]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:34 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:15:34 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:35 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.610s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:35 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 1G Sep 28 15:15:35 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:36 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 1G" returned: 0 in 0.975s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:36 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 Sep 28 15:15:36 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:36 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" returned: 0 in 0.670s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:36 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 is being set with open permissions: ugo+rw Sep 28 15:15:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:37 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 Sep 28 15:15:37 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:37 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" returned: 0 in 0.698s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:37 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info Sep 28 15:15:37 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:38 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info" returned: 0 in 0.791s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:38 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info is being set with open permissions: ugo+rw Sep 28 15:15:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:38 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info Sep 28 15:15:38 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:38 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.info" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-658b701e-e420-4a51-a18a-426aec3b08ff tempest-SnapshotDependencyTests-304558082 None] Create snapshot completed successfully Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Flow 'volume_create_manager' (b9026988-d91a-4ff9-acba-081a233f2cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b72606-8bea-461f-829a-9e8d78fa6bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b72606-8bea-461f-829a-9e8d78fa6bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1212973342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39403230-7b9e-4f76-806c-dcb6fb0da7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54d2d3b7ac247fd8b5e504a8baa3c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:40Z,use_quota=True,user_id='e977b12b5b4b4eb89ade971cb4a7e1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46a9bcd-05c4-4ab1-8e1e-70bea0caaf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46a9bcd-05c4-4ab1-8e1e-70bea0caaf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad4445a-7cba-4804-9387-9c954c8276bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad4445a-7cba-4804-9387-9c954c8276bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39403230-7b9e-4f76-806c-dcb6fb0da7fe', 'volume_name': 'volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bff2216-628c-46b1-bc83-92d679ded23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bff2216-628c-46b1-bc83-92d679ded23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c15b71-c7df-4645-8732-9767ff5640e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Volume 39403230-7b9e-4f76-806c-dcb6fb0da7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe', 'volume_size': 1} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1212973342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39403230-7b9e-4f76-806c-dcb6fb0da7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54d2d3b7ac247fd8b5e504a8baa3c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:40Z,use_quota=True,user_id='e977b12b5b4b4eb89ade971cb4a7e1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Creating volume 39403230-7b9e-4f76-806c-dcb6fb0da7fe {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:40 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:40 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe 1073741824 Sep 28 15:15:40 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:40 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:15:40 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:41 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe 1073741824" returned: 0 in 1.233s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:41 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.721s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:41 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe Sep 28 15:15:41 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:41 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe" returned: 0 in 0.510s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:15:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c15b71-c7df-4645-8732-9767ff5640e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9422ee0b-816a-47d8-ae86-f446f72c3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:42 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Volume volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe (39403230-7b9e-4f76-806c-dcb6fb0da7fe): created successfully Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9422ee0b-816a-47d8-ae86-f446f72c3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Flow 'volume_create_manager' (b9026988-d91a-4ff9-acba-081a233f2cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-57a0ae2a-634b-4a77-80a9-7c7d83023b06 tempest-VolumesTransfersV357Test-1709773568 None] Created volume successfully. Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Flow 'volume_create_manager' (287fad84-ddd6-4c0d-ba1a-3811fba19a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72be6c61-c156-47ba-be86-5c336cb52b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72be6c61-c156-47ba-be86-5c336cb52b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4db5f2-8812-4cd7-87cb-eed97bbb9772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0436a4abfb4856a806db3a1cb52e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f86ebdd-55a2-4e1a-b250-dd7d62e309b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:42Z,use_quota=True,user_id='60641c3772914e2e87884ae404b03f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6765edfd-b7d3-45f7-b9f1-a609e9fef3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6765edfd-b7d3-45f7-b9f1-a609e9fef3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299ef45e-797e-4af3-bf2a-ee0854e2e76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299ef45e-797e-4af3-bf2a-ee0854e2e76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b4db5f2-8812-4cd7-87cb-eed97bbb9772', 'volume_name': 'volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772', 'volume_size': 1, 'snapshot_id': '5f86ebdd-55a2-4e1a-b250-dd7d62e309b7'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d64865b-4c4c-41e8-8d4f-09a7582c1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d64865b-4c4c-41e8-8d4f-09a7582c1df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6afbaec-154b-40e8-a9b2-10a9cf4f7b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:42 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Volume 7b4db5f2-8812-4cd7-87cb-eed97bbb9772: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772', 'volume_size': 1, 'snapshot_id': '5f86ebdd-55a2-4e1a-b250-dd7d62e309b7'} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-quobyte-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Creating volume 7b4db5f2-8812-4cd7-87cb-eed97bbb9772 from snapshot 5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-quobyte-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] snapshot: 5f86ebdd-55a2-4e1a-b250-dd7d62e309b7, volume: 7b4db5f2-8812-4cd7-87cb-eed97bbb9772, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[576aa84c-da20-4878-b626-7b0e472827aa]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:42 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 Sep 28 15:15:42 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:43 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" returned: 0 in 0.764s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:15:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:15:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b6ba2-ebfe-4030-a3e4-92a7ba6d4a34]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:43 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:15:43 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:44 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.676s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:44 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:15:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:44 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 Sep 28 15:15:44 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-85d08b82-59e8-4851-a7e9-d16fee6e5c19 tempest-VolumesTransfersV357Test-794601588 None] Transfer volume completed successfully. Sep 28 15:15:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Acquiring lock "cinder-39403230-7b9e-4f76-806c-dcb6fb0da7fe-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-39403230-7b9e-4f76-806c-dcb6fb0da7fe-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Acquiring lock "cinder-quobyte-39403230-7b9e-4f76-806c-dcb6fb0da7fe" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-quobyte-39403230-7b9e-4f76-806c-dcb6fb0da7fe" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241a8e1-2700-4797-a908-6d00bfe1a3f2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:48 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe Sep 28 15:15:48 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:49 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe" returned: 0 in 1.597s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:49 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe Sep 28 15:15:49 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:50 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-39403230-7b9e-4f76-806c-dcb6fb0da7fe" returned: 0 in 0.813s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-quobyte-39403230-7b9e-4f76-806c-dcb6fb0da7fe" released by "delete_volume" :: held 2.576s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:50 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Created reservations ['436716e4-209a-42a4-97e7-983408e5808f', 'f4f67c35-fb44-412c-bf7b-054cd3bf44ee', 'f92bc1ce-17d1-4a9b-8332-a92a986b1a7f', 'e093b74d-5078-411c-b0fe-aecdbd8d570a'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:51 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:15:51 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:52 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 1.061s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:52 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Deleted volume successfully. Sep 28 15:15:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5bd2b17-ad80-428a-b2a5-1847b2279a31 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-39403230-7b9e-4f76-806c-dcb6fb0da7fe-delete_volume" released by "delete_volume" :: held 4.391s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:53 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Flow 'volume_create_manager' (965bbc8a-f92c-441b-86a8-d9b29ff61fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d41f9a-e6a9-479c-8b5d-804a8ba62cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d41f9a-e6a9-479c-8b5d-804a8ba62cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1395315703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905fb9ac-c3b6-416f-b263-ac4e016786fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54d2d3b7ac247fd8b5e504a8baa3c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:54Z,use_quota=True,user_id='e977b12b5b4b4eb89ade971cb4a7e1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae86b70-9003-47f1-96d1-fef4cb53f511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae86b70-9003-47f1-96d1-fef4cb53f511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0625a75d-12cc-4f36-8115-0f5bf933bf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0625a75d-12cc-4f36-8115-0f5bf933bf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905fb9ac-c3b6-416f-b263-ac4e016786fd', 'volume_name': 'volume-905fb9ac-c3b6-416f-b263-ac4e016786fd', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7fbb06-13d3-4acf-8fa6-d460e15c6dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7fbb06-13d3-4acf-8fa6-d460e15c6dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f83f836-818a-4fd5-82fb-46d7f6075a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:54 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Volume 905fb9ac-c3b6-416f-b263-ac4e016786fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905fb9ac-c3b6-416f-b263-ac4e016786fd', 'volume_size': 1} Sep 28 15:15:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:56 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" returned: 0 in 11.995s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fc5103-4c9d-4d24-8bfa-fc3c90b04494]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:15:56 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.611s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4, size 1024.00 MB, duration 12.00 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:15:56 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Converted 1024.00 MB image at 85.35 MB/s Sep 28 15:15:56 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 is being set with open permissions: ugo+rw Sep 28 15:15:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 Sep 28 15:15:56 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" returned: 0 in 0.273s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" released by "_copy_volume_from_snapshot" :: held 14.525s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" released by "_create_volume_from_snapshot" :: held 14.615s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.664s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1395315703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905fb9ac-c3b6-416f-b263-ac4e016786fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54d2d3b7ac247fd8b5e504a8baa3c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:54Z,use_quota=True,user_id='e977b12b5b4b4eb89ade971cb4a7e1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Creating volume 905fb9ac-c3b6-416f-b263-ac4e016786fd {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:57 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd 1073741824 Sep 28 15:15:57 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6afbaec-154b-40e8-a9b2-10a9cf4f7b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772', 'volume_size': 1, 'snapshot_id': '5f86ebdd-55a2-4e1a-b250-dd7d62e309b7'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca3133d-b760-4c38-afe0-41ac3c4f45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:57 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Volume volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 (7b4db5f2-8812-4cd7-87cb-eed97bbb9772): created successfully Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca3133d-b760-4c38-afe0-41ac3c4f45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Flow 'volume_create_manager' (287fad84-ddd6-4c0d-ba1a-3811fba19a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8b78571e-eacf-4b30-b7e4-298ae95d3e52 tempest-SnapshotDependencyTests-304558082 None] Created volume successfully. Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Flow 'volume_create_manager' (8263e68d-4efa-4456-831c-84f84d67422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad6007d-53a6-40a4-8825-b28599dbb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad6007d-53a6-40a4-8825-b28599dbb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-528416065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94a65de-d106-44c0-978a-83bcefb8019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938a71dbf68047afa1a0486fc6a06720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:58Z,use_quota=True,user_id='a4179bb8225b468895ddd8568f9a484a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c18c1fd-d003-4769-a28e-fe8aeedb0325),volume_type_id=2c18c1fd-d003-4769-a28e-fe8aeedb0325)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cfa181-1d59-4e3e-97ce-24a289516274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cfa181-1d59-4e3e-97ce-24a289516274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d36192-e40b-403d-a4e7-92e198e69e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:57 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d36192-e40b-403d-a4e7-92e198e69e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94a65de-d106-44c0-978a-83bcefb8019b', 'volume_name': 'volume-c94a65de-d106-44c0-978a-83bcefb8019b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17eefbac-b8eb-4306-8a97-714b1fdcc6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17eefbac-b8eb-4306-8a97-714b1fdcc6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f95ed9-59e0-4c13-ade5-80a2ddea82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:57 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume c94a65de-d106-44c0-978a-83bcefb8019b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94a65de-d106-44c0-978a-83bcefb8019b', 'volume_size': 1} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd 1073741824" returned: 0 in 0.623s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd Sep 28 15:15:58 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-quobyte-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Flow 'volume_create_manager' (37348673-4bc1-440b-8ab2-18249c796e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee74529-d535-4b39-8862-0fe12d318dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-quobyte-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee74529-d535-4b39-8862-0fe12d318dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-635961453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fe715e-f4b2-4573-81c3-6435900cba5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938a71dbf68047afa1a0486fc6a06720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:58Z,use_quota=True,user_id='a4179bb8225b468895ddd8568f9a484a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36053213-c546-40a5-892f-d0993bc79bce),volume_type_id=36053213-c546-40a5-892f-d0993bc79bce)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175153a3-4624-41e6-b1ed-9f6a7339b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175153a3-4624-41e6-b1ed-9f6a7339b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c1cced-2bae-4e39-afd5-cafe6f6d0f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c1cced-2bae-4e39-afd5-cafe6f6d0f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fe715e-f4b2-4573-81c3-6435900cba5a', 'volume_name': 'volume-a3fe715e-f4b2-4573-81c3-6435900cba5a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46df86ba-e28c-4c9e-9ff9-94caead3f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46df86ba-e28c-4c9e-9ff9-94caead3f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5935ac06-0b4c-499f-b95e-408e434c3d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume a3fe715e-f4b2-4573-81c3-6435900cba5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fe715e-f4b2-4573-81c3-6435900cba5a', 'volume_size': 1} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Deleting offline snapshot 5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 of volume 0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] snapshot_file for this snap is: volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd" returned: 0 in 0.516s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-528416065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94a65de-d106-44c0-978a-83bcefb8019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938a71dbf68047afa1a0486fc6a06720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:58Z,use_quota=True,user_id='a4179bb8225b468895ddd8568f9a484a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c18c1fd-d003-4769-a28e-fe8aeedb0325),volume_type_id=2c18c1fd-d003-4769-a28e-fe8aeedb0325)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Creating volume c94a65de-d106-44c0-978a-83bcefb8019b {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:58 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edcd4d4-ac25-4650-97b7-8ffeb16ee858]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b 1073741824 Sep 28 15:15:58 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f83f836-818a-4fd5-82fb-46d7f6075a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905fb9ac-c3b6-416f-b263-ac4e016786fd', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c1ccd-25ee-4545-8167-c6185df8e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Volume volume-905fb9ac-c3b6-416f-b263-ac4e016786fd (905fb9ac-c3b6-416f-b263-ac4e016786fd): created successfully Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c1ccd-25ee-4545-8167-c6185df8e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Flow 'volume_create_manager' (965bbc8a-f92c-441b-86a8-d9b29ff61fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-954cdb42-ad95-4eb0-ae27-54c8bb72d90f tempest-VolumesTransfersV357Test-1709773568 None] Created volume successfully. Sep 28 15:15:58 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 Sep 28 15:15:58 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Flow 'volume_create_manager' (d5a4a5c8-5cd0-4dcd-bd67-0eaff5e4a011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe68edec-be55-4ba9-af08-349b293feae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe68edec-be55-4ba9-af08-349b293feae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-217858246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee40e93a-4009-4715-838e-469423bdfbc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938a71dbf68047afa1a0486fc6a06720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:59Z,use_quota=True,user_id='a4179bb8225b468895ddd8568f9a484a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77b5dc66-f264-4037-ba54-417981d43571),volume_type_id=77b5dc66-f264-4037-ba54-417981d43571)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab1e07-42bd-454f-863e-233d8ac68c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab1e07-42bd-454f-863e-233d8ac68c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1443ed-cdc9-4847-9c68-793efb628da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:15:59 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" returned: 0 in 0.672s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c45abb-59c8-4338-8bfa-226ca36efa88]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b 1073741824" returned: 0 in 0.794s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:15:59 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b Sep 28 15:15:59 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Acquiring lock "cinder-905fb9ac-c3b6-416f-b263-ac4e016786fd-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-905fb9ac-c3b6-416f-b263-ac4e016786fd-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1443ed-cdc9-4847-9c68-793efb628da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee40e93a-4009-4715-838e-469423bdfbc3', 'volume_name': 'volume-ee40e93a-4009-4715-838e-469423bdfbc3', 'volume_size': 1, 'image_id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2792c8f3-ba33-4a8a-869b-90cef733a809', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--664505454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '938a71dbf68047afa1a0486fc6a06720', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2792c8f3-ba33-4a8a-869b-90cef733a809/file', 'properties': {}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009138b8-1454-4cf8-a589-30025b180640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009138b8-1454-4cf8-a589-30025b180640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d518cf2-18d6-4e8a-9807-35b334c593b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume ee40e93a-4009-4715-838e-469423bdfbc3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee40e93a-4009-4715-838e-469423bdfbc3', 'volume_size': 1, 'image_id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2792c8f3-ba33-4a8a-869b-90cef733a809', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--664505454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '938a71dbf68047afa1a0486fc6a06720', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2792c8f3-ba33-4a8a-869b-90cef733a809/file', 'properties': {}}, 'image_service': } Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Trying to clone ee40e93a-4009-4715-838e-469423bdfbc3 from image 2792c8f3-ba33-4a8a-869b-90cef733a809 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2792c8f3-ba33-4a8a-869b-90cef733a809', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Acquiring lock "cinder-quobyte-905fb9ac-c3b6-416f-b263-ac4e016786fd" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-quobyte-905fb9ac-c3b6-416f-b263-ac4e016786fd" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:59 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b" returned: 0 in 0.426s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[994379f6-e06d-41bd-b47d-fc4ccc8d7476]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-635961453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fe715e-f4b2-4573-81c3-6435900cba5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938a71dbf68047afa1a0486fc6a06720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:58Z,use_quota=True,user_id='a4179bb8225b468895ddd8568f9a484a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36053213-c546-40a5-892f-d0993bc79bce),volume_type_id=36053213-c546-40a5-892f-d0993bc79bce)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Creating volume a3fe715e-f4b2-4573-81c3-6435900cba5a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:15:59 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.627s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a 1073741824 Sep 28 15:15:59 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f95ed9-59e0-4c13-ade5-80a2ddea82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94a65de-d106-44c0-978a-83bcefb8019b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0741fa9-3201-4aaf-aea8-5a3ba4843155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 Sep 28 15:15:59 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume volume-c94a65de-d106-44c0-978a-83bcefb8019b (c94a65de-d106-44c0-978a-83bcefb8019b): created successfully Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0741fa9-3201-4aaf-aea8-5a3ba4843155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Flow 'volume_create_manager' (8263e68d-4efa-4456-831c-84f84d67422e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dbfb9c05-38b6-4e8e-82c0-32ca0c09f8bb tempest-TestInstancesWithCinderVolumes-1970037286 None] Created volume successfully. Sep 28 15:16:00 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd Sep 28 15:16:00 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd" returned: 0 in 0.624s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" returned: 0 in 0.595s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd Sep 28 15:16:00 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7 Sep 28 15:16:00 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a 1073741824" returned: 0 in 0.729s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a Sep 28 15:16:00 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4.5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" returned: 0 in 0.387s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-905fb9ac-c3b6-416f-b263-ac4e016786fd" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-quobyte-905fb9ac-c3b6-416f-b263-ac4e016786fd" released by "delete_volume" :: held 1.154s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a" returned: 0 in 0.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7" released by "_delete_snapshot" :: held 2.491s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" released by "delete_snapshot" :: held 2.581s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5935ac06-0b4c-499f-b95e-408e434c3d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fe715e-f4b2-4573-81c3-6435900cba5a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5ddd44-bae7-48ab-80e5-9460d4f90cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume volume-a3fe715e-f4b2-4573-81c3-6435900cba5a (a3fe715e-f4b2-4573-81c3-6435900cba5a): created successfully Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5ddd44-bae7-48ab-80e5-9460d4f90cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Flow 'volume_create_manager' (37348673-4bc1-440b-8ab2-18249c796e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b24b11aa-a0be-44b8-a650-cd2edc93a396 tempest-TestInstancesWithCinderVolumes-1970037286 None] Created volume successfully. Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Created reservations ['0c51bd9e-33f3-44e3-bcc1-fd9583cabe2e', '64e6a027-e04f-4e50-9e99-937522e7e0f3', '96bbc499-c54c-49d8-9737-bb745381446b', '740dc695-72bf-48e8-87e1-72f9e22afe07'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Created reservations ['1b9f4100-a93a-4110-9170-6c4c8fe283c7', 'e52d35dd-52ab-4a72-8084-ab5b1fa154b5', '4850c20a-35c5-42de-b50b-08157c2aa5f4', '1ca8f18e-45b0-4d34-abc2-21dc5e3b9c75'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:16:01 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Delete snapshot completed successfully. Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-873bcba9-41d7-4ccf-ba51-b374068a6897 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-5f86ebdd-55a2-4e1a-b250-dd7d62e309b7-delete_snapshot" released by "delete_snapshot" :: held 2.966s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:01 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.320s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Deleted volume successfully. Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-69997863-d491-4605-b8dd-812683485414 tempest-VolumesTransfersV357Test-2131809639 None] Lock "cinder-905fb9ac-c3b6-416f-b263-ac4e016786fd-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-quobyte-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ab78e-94f7-46ef-9bb0-ac9736cc68a0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:16:01 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:02 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.796s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4 Sep 28 15:16:02 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" returned: 0 in 0.471s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4" released by "delete_volume" :: held 1.382s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Created reservations ['f990e464-aae8-4c7d-a813-1a666a19ca1b', '431872c2-5489-4754-805b-e17baa7de141', '6c6cc5ab-0645-42ec-926a-6f374d692f4b', 'ded6b79d-e433-4054-9f09-173d3c77e1be'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:16:03 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.338s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Deleted volume successfully. Sep 28 15:16:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-232603a1-ed70-47bd-b192-fe3339d9d18e tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-0ebd9a4a-764a-4f36-ac00-d00c8edbc8d4-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-7b4db5f2-8812-4cd7-87cb-eed97bbb9772-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-7b4db5f2-8812-4cd7-87cb-eed97bbb9772-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "cinder-quobyte-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a27fc-be8b-43e1-b6e8-41f9993d634f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:04 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 Sep 28 15:16:04 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" returned: 0 in 0.562s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772 Sep 28 15:16:05 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-quobyte-7b4db5f2-8812-4cd7-87cb-eed97bbb9772" released by "delete_volume" :: held 1.120s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Created reservations ['a4bfa796-7499-4965-9ec4-b3451d393cec', '1dc361d8-a74b-44a0-938a-9e5aec697c59', 'd956f83f-6545-456b-b9e6-2d2e6bf9f0e1', '286a722d-5b91-4310-95e2-1f0023a03cfd'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:16:05 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD, size 20.69 MB, duration 6.17 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:16:05 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Image download 20.69 MB at 3.35 MB/s Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a865e77-d9bb-49a3-8b56-5b4c843150a4]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:06 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.364s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Deleted volume successfully. Sep 28 15:16:06 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD Sep 28 15:16:06 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-77c3d1fd-9c2f-4a79-8d84-790558502136 tempest-SnapshotDependencyTests-304558082 None] Lock "cinder-7b4db5f2-8812-4cd7-87cb-eed97bbb9772-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:06 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Temporary image 2792c8f3-ba33-4a8a-869b-90cef733a809 is fetched for user a4179bb8225b468895ddd8568f9a484a. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1496dec-dbad-4508-8569-c078e422a8b6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:06 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD Sep 28 15:16:06 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:07 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-217858246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee40e93a-4009-4715-838e-469423bdfbc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938a71dbf68047afa1a0486fc6a06720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:59Z,use_quota=True,user_id='a4179bb8225b468895ddd8568f9a484a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77b5dc66-f264-4037-ba54-417981d43571),volume_type_id=77b5dc66-f264-4037-ba54-417981d43571)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Creating volume ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:16:07 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:07 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 1073741824 Sep 28 15:16:07 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:07 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 1073741824" returned: 0 in 0.772s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:16:08 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:08 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 0 in 0.421s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.941s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e026278-9e12-4243-b883-e74e1710f879]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Attempting download of 2792c8f3-ba33-4a8a-869b-90cef733a809 ((None, [{'url': 'file:///opt/stack/data/glance/images/2792c8f3-ba33-4a8a-869b-90cef733a809', 'metadata': {}}])) to volume ee40e93a-4009-4715-838e-469423bdfbc3. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7998be-e4ab-46fa-9af0-6797be990a7d]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 Sep 28 15:16:08 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:08 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6 Sep 28 15:16:08 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:09 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6" returned: 0 in 0.472s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:09 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779" returned: 0 in 0.591s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.640s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eeea801c-1555-47c5-b88f-959d9b194cd9', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:16:09 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6 Sep 28 15:16:09 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-8a21f194-410d-4638-bfb5-da5949b8488e req-c9c06acd-fb65-4ca0-b351-f205b6a1439d tempest-TestServerVolumeAttachmentScenario-1940811313 None] attachment_update completed successfully. Sep 28 15:16:09 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6" returned: 1 in 0.590s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2792c8f3-ba33-4a8a-869b-90cef733a809_mlyur8n6' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e0fa72-1970-4e4c-a4c4-d228be60aac8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:09 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD Sep 28 15:16:09 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:10 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:10 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] 2792c8f3-ba33-4a8a-869b-90cef733a809 was qcow2, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:16:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:10 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:16:10 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 0 in 2.473s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:12 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2792c8f3-ba33-4a8a-869b-90cef733a809_ldjlhn53devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:16:12 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Converted 112.00 MB image at 45.14 MB/s Sep 28 15:16:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 1G Sep 28 15:16:12 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 1G" returned: 0 in 0.527s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[80df1691-ba42-4665-806e-185fa4bfeb7e]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:13 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:16:13 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:14 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 0 in 0.834s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:14 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:16:14 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:14 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 1 in 0.624s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Downloaded image 2792c8f3-ba33-4a8a-869b-90cef733a809 ((None, [{'url': 'file:///opt/stack/data/glance/images/2792c8f3-ba33-4a8a-869b-90cef733a809', 'metadata': {}}])) to volume ee40e93a-4009-4715-838e-469423bdfbc3 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Temporary image 2792c8f3-ba33-4a8a-869b-90cef733a809 for user a4179bb8225b468895ddd8568f9a484a is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Marking volume ee40e93a-4009-4715-838e-469423bdfbc3 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Copying metadata from image 2792c8f3-ba33-4a8a-869b-90cef733a809 to ee40e93a-4009-4715-838e-469423bdfbc3. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Creating volume glance metadata for volume ee40e93a-4009-4715-838e-469423bdfbc3 backed by image 2792c8f3-ba33-4a8a-869b-90cef733a809 with: {'image_id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'image_name': 'tempest-scenario-img--664505454', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d518cf2-18d6-4e8a-9807-35b334c593b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee40e93a-4009-4715-838e-469423bdfbc3', 'volume_size': 1, 'image_id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2792c8f3-ba33-4a8a-869b-90cef733a809', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--664505454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '938a71dbf68047afa1a0486fc6a06720', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2792c8f3-ba33-4a8a-869b-90cef733a809', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2792c8f3-ba33-4a8a-869b-90cef733a809/file', 'properties': {}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9a62e7-8184-4539-8464-641a442f8ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Volume volume-ee40e93a-4009-4715-838e-469423bdfbc3 (ee40e93a-4009-4715-838e-469423bdfbc3): created successfully Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9a62e7-8184-4539-8464-641a442f8ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Flow 'volume_create_manager' (d5a4a5c8-5cd0-4dcd-bd67-0eaff5e4a011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-38797468-67ed-40ac-b7a5-93ed3a434258 tempest-TestInstancesWithCinderVolumes-1970037286 None] Created volume successfully. Sep 28 15:16:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:16 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a888fa-156e-4097-a124-e707cb825c59]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:16 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 Sep 28 15:16:16 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:17 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1" returned: 0 in 0.609s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.641s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd44e7331-2f00-48d1-9294-ae052606909f', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:16:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-23d4066a-0a4e-41db-9d25-70e97550e64a req-3ca3f6bd-0832-4178-9d13-6b85339c7d6a tempest-TestServerVolumeAttachmentScenario-1940811313 None] attachment_update completed successfully. Sep 28 15:16:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-41ed7380-b58d-491a-87e9-499a73e38303 req-423f4a10-24a9-4b7d-9409-9cc606723ebd tempest-TestServerVolumeAttachmentScenario-1940811313 None] Terminate volume connection completed successfully. Sep 28 15:16:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-41ed7380-b58d-491a-87e9-499a73e38303 req-423f4a10-24a9-4b7d-9409-9cc606723ebd tempest-TestServerVolumeAttachmentScenario-1940811313 None] Deleting attachment d44e7331-2f00-48d1-9294-ae052606909f. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:16:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-d6e1c707-94d8-466d-9afb-ee4df0c33d19 req-d40c9e5e-e42e-4cec-b725-66a8072ad953 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Terminate volume connection completed successfully. Sep 28 15:16:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-d6e1c707-94d8-466d-9afb-ee4df0c33d19 req-d40c9e5e-e42e-4cec-b725-66a8072ad953 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Deleting attachment eeea801c-1555-47c5-b88f-959d9b194cd9. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:16:26 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=59,cinder:SELECT=71,cinder:INSERT=18,cinder:DELETE=8 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:26 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=56,cinder:UPDATE=68,cinder:DELETE=4,cinder:INSERT=18 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:26 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a7012-91c6-475d-8110-8e2d91cf06cb]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:16:26 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 0 in 0.930s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:16:27 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:28 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 1 in 0.857s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.868s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-ee40e93a-4009-4715-838e-469423bdfbc3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd51b255-2077-483a-80d5-5b02ed7608a4', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:16:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c7042e23-43fa-4e4a-becf-610a5d641626 req-92c52a9b-e797-40ea-9299-3f54857fffbe tempest-TestInstancesWithCinderVolumes-1970037286 None] attachment_update completed successfully. Sep 28 15:16:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "cinder-f8d4f2db-9919-4db0-9dca-58b53b2292f1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-f8d4f2db-9919-4db0-9dca-58b53b2292f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "cinder-quobyte-f8d4f2db-9919-4db0-9dca-58b53b2292f1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-quobyte-f8d4f2db-9919-4db0-9dca-58b53b2292f1" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b25dcef-87a3-4ad2-abd3-170bc437c66d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 Sep 28 15:16:31 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:32 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1" returned: 0 in 0.719s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:32 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1 Sep 28 15:16:32 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Flow 'volume_create_manager' (1a76aece-a8ce-42ae-b4b1-d53687cbf2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd69cb8e-221e-4fa7-8b06-26589ba81f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd69cb8e-221e-4fa7-8b06-26589ba81f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1625578321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a5b021-6e45-4c1a-b854-00f015348912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65b73dd7d9342cb9dd9c014927e20dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:32Z,use_quota=True,user_id='2e71b3bfca09418490789bbedd864e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88ebc0f-1366-4f50-a865-9bb655026796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88ebc0f-1366-4f50-a865-9bb655026796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d486ee4-6ffd-4660-972a-becd25b4e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d486ee4-6ffd-4660-972a-becd25b4e93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a5b021-6e45-4c1a-b854-00f015348912', 'volume_name': 'volume-84a5b021-6e45-4c1a-b854-00f015348912', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de08265-1d7e-4939-b0bf-7f017b657c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de08265-1d7e-4939-b0bf-7f017b657c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03760ff3-9f1e-423c-81db-43b72bd02fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Volume 84a5b021-6e45-4c1a-b854-00f015348912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a5b021-6e45-4c1a-b854-00f015348912', 'volume_size': 1} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1625578321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a5b021-6e45-4c1a-b854-00f015348912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65b73dd7d9342cb9dd9c014927e20dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:32Z,use_quota=True,user_id='2e71b3bfca09418490789bbedd864e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Creating volume 84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:16:32 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:32 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 1073741824 Sep 28 15:16:32 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:32 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f8d4f2db-9919-4db0-9dca-58b53b2292f1" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-quobyte-f8d4f2db-9919-4db0-9dca-58b53b2292f1" released by "delete_volume" :: held 1.220s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:32 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Created reservations ['fe334f3d-4ee5-4089-a8ca-2ecc42ae8e46', '127cb172-2e66-4b2e-872d-033d7e859f5a', '72c603e1-083a-4bfd-8cce-353a99e62be2', '6186bb9b-a610-452f-b087-abd508bb838c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:16:33 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 1073741824" returned: 0 in 0.764s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:16:33 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.358s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Deleted volume successfully. Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-17ec731b-02f3-483c-aeac-2721851552b9 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-f8d4f2db-9919-4db0-9dca-58b53b2292f1-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:33 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.330s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03760ff3-9f1e-423c-81db-43b72bd02fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a5b021-6e45-4c1a-b854-00f015348912', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b6ed0d-fd23-42d3-af39-0e3995a9d1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Volume volume-84a5b021-6e45-4c1a-b854-00f015348912 (84a5b021-6e45-4c1a-b854-00f015348912): created successfully Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b6ed0d-fd23-42d3-af39-0e3995a9d1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Flow 'volume_create_manager' (1a76aece-a8ce-42ae-b4b1-d53687cbf2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c9bd9a59-a767-4752-b45a-1ff6b39a3a02 tempest-VolumesActionsTest-259442691 None] Created volume successfully. Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "cinder-ef55742d-aa6b-43d0-96be-f76b9e3c8779-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-ef55742d-aa6b-43d0-96be-f76b9e3c8779-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "cinder-quobyte-ef55742d-aa6b-43d0-96be-f76b9e3c8779" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-quobyte-ef55742d-aa6b-43d0-96be-f76b9e3c8779" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e636e85-824c-46e2-8fae-c901f1583d46]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:34 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 Sep 28 15:16:34 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:34 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779" returned: 0 in 0.949s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779 Sep 28 15:16:35 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:35 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ef55742d-aa6b-43d0-96be-f76b9e3c8779" returned: 0 in 0.433s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-quobyte-ef55742d-aa6b-43d0-96be-f76b9e3c8779" released by "delete_volume" :: held 1.484s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Created reservations ['02c9f894-cee2-40f5-8628-7b848e17f7fd', 'ec23d61f-ddaf-44d2-8c05-61e2c44641ea', 'df87ef56-db23-4c21-a59d-9123c88a66a1', '53869b9a-653a-4460-857c-0d91156c840b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:16:35 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:36 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.372s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:36 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:36 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Deleted volume successfully. Sep 28 15:16:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bb7d3041-3fb1-4ba9-892d-f839aef26323 tempest-TestServerVolumeAttachmentScenario-1940811313 None] Lock "cinder-ef55742d-aa6b-43d0-96be-f76b9e3c8779-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:40 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:16:40 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:40 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.359s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:16:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:16:45 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=18 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:46 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f3e67841-40da-4947-ab53-071278069811 tempest-VolumesActionsTest-259442691 None] Acquiring lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912" by "attach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f3e67841-40da-4947-ab53-071278069811 tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912" acquired by "attach_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f3e67841-40da-4947-ab53-071278069811 tempest-VolumesActionsTest-259442691 None] Attaching volume 84a5b021-6e45-4c1a-b854-00f015348912 to instance 6bc6778d-579c-45ab-8ac4-03f993c27b1a at mountpoint /dev/vdb on host None. Sep 28 15:16:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f3e67841-40da-4947-ab53-071278069811 tempest-VolumesActionsTest-259442691 None] Attach volume completed successfully. Sep 28 15:16:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-f3e67841-40da-4947-ab53-071278069811 tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912" released by "attach_volume" :: held 0.165s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-68c344a2-327f-4dfa-94f9-11bb37ce4de0 tempest-VolumesActionsTest-259442691 None] Acquiring lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-detach_volume" by "detach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-68c344a2-327f-4dfa-94f9-11bb37ce4de0 tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-68c344a2-327f-4dfa-94f9-11bb37ce4de0 tempest-VolumesActionsTest-259442691 None] Detaching volume 84a5b021-6e45-4c1a-b854-00f015348912 from instance 6bc6778d-579c-45ab-8ac4-03f993c27b1a. Sep 28 15:16:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-68c344a2-327f-4dfa-94f9-11bb37ce4de0 tempest-VolumesActionsTest-259442691 None] Detach volume completed successfully. Sep 28 15:16:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-68c344a2-327f-4dfa-94f9-11bb37ce4de0 tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:03 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:03 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:10 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f9129-691d-4e2b-9d60-8b5952382973]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b Sep 28 15:17:11 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b" returned: 0 in 0.661s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.735s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-c94a65de-d106-44c0-978a-83bcefb8019b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a4b05f9-be9e-4bb1-99ff-daf2e298d3bb', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:17:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-982f4211-0ed1-46a1-9c3e-4492a364a570 req-c6dd540e-f3ca-492e-b3b8-d0d57ef22bf3 tempest-TestInstancesWithCinderVolumes-1970037286 None] attachment_update completed successfully. Sep 28 15:17:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5d827018-f457-4811-9b4e-835b6fd98176 tempest-VolumesActionsTest-259442691 None] Acquiring lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912" by "attach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5d827018-f457-4811-9b4e-835b6fd98176 tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912" acquired by "attach_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5d827018-f457-4811-9b4e-835b6fd98176 tempest-VolumesActionsTest-259442691 None] Attaching volume 84a5b021-6e45-4c1a-b854-00f015348912 to instance d1292403-6c01-49f9-b283-8580873287b2 at mountpoint /dev/vdb on host None. Sep 28 15:17:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5d827018-f457-4811-9b4e-835b6fd98176 tempest-VolumesActionsTest-259442691 None] Attach volume completed successfully. Sep 28 15:17:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5d827018-f457-4811-9b4e-835b6fd98176 tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912" released by "attach_volume" :: held 0.190s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-70a7e586-c525-4d5e-bbdd-9f02bf071b8e tempest-VolumesActionsTest-259442691 None] Acquiring lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-detach_volume" by "detach_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-70a7e586-c525-4d5e-bbdd-9f02bf071b8e tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-70a7e586-c525-4d5e-bbdd-9f02bf071b8e tempest-VolumesActionsTest-259442691 None] Detaching volume 84a5b021-6e45-4c1a-b854-00f015348912 from instance d1292403-6c01-49f9-b283-8580873287b2. Sep 28 15:17:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-70a7e586-c525-4d5e-bbdd-9f02bf071b8e tempest-VolumesActionsTest-259442691 None] Detach volume completed successfully. Sep 28 15:17:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-70a7e586-c525-4d5e-bbdd-9f02bf071b8e tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:16 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b126f9-524a-4301-8d17-6735a0a1331c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:16 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a Sep 28 15:17:16 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:17 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a" returned: 0 in 0.844s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-a3fe715e-f4b2-4573-81c3-6435900cba5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc14f15d-c7d7-4ecc-a605-ef335b74da46', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:17:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-f6ce3057-78df-4285-8178-b76fb858fe2e req-7cf12448-a222-4b85-98b0-4815bcfdb158 tempest-TestInstancesWithCinderVolumes-1970037286 None] attachment_update completed successfully. Sep 28 15:17:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b6e0ec-e82c-4d06-b1e7-7b2218f41932]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:17:21 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:22 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.473s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e94898-a6d3-4fad-8423-35ec8cd79a56]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:22 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:17:22 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:22 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.530s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.52f0399c-52b1-4949-9a0b-c671961d123aueakwcvv.img {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:22 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.52f0399c-52b1-4949-9a0b-c671961d123aueakwcvv.img Sep 28 15:17:22 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:25 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-ffbab06c-de6a-4e48-a412-00f4dac92827 req-8d4ee67f-2b45-44c4-a3b0-5528673f409f tempest-TestInstancesWithCinderVolumes-1970037286 None] Terminate volume connection completed successfully. Sep 28 15:17:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-ffbab06c-de6a-4e48-a412-00f4dac92827 req-8d4ee67f-2b45-44c4-a3b0-5528673f409f tempest-TestInstancesWithCinderVolumes-1970037286 None] Deleting attachment 9a4b05f9-be9e-4bb1-99ff-daf2e298d3bb. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "cinder-c94a65de-d106-44c0-978a-83bcefb8019b-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-c94a65de-d106-44c0-978a-83bcefb8019b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "cinder-quobyte-c94a65de-d106-44c0-978a-83bcefb8019b" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-quobyte-c94a65de-d106-44c0-978a-83bcefb8019b" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:27 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ec5f1-e0d2-4e1f-aafa-65a219514c3b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:27 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b Sep 28 15:17:27 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:28 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b" returned: 0 in 0.963s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:28 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b Sep 28 15:17:28 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:29 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c94a65de-d106-44c0-978a-83bcefb8019b" returned: 0 in 0.806s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-quobyte-c94a65de-d106-44c0-978a-83bcefb8019b" released by "delete_volume" :: held 1.906s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:29 devstack cinder-volume[86888]: WARNING cinder.quota [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-476014629-2109454226 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-476014629-2109454226, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:17:29 devstack cinder-volume[86888]: WARNING cinder.quota [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-476014629-2109454226 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-476014629-2109454226, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Created reservations ['95679e18-7cae-4c76-ba18-dbb01d67dbb6', 'a32ef218-d287-426c-aaa4-25947d3fd28f', '6cb3b00d-b409-48c2-bea0-53650ebf2b5c', '60300bda-0ba9-4c14-aa49-879b0a9ddde3'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:29 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:17:29 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:30 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.498s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:30 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deleted volume successfully. Sep 28 15:17:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c80eaadf-d20d-48c5-abde-f6e5f5ecbee5 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-c94a65de-d106-44c0-978a-83bcefb8019b-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:32 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.52f0399c-52b1-4949-9a0b-c671961d123aueakwcvv.img" returned: 0 in 9.847s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:32 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e304e4a8-0222-4979-b02f-e32db0a2d62c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:32 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:17:32 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:33 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.869s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:33 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.52f0399c-52b1-4949-9a0b-c671961d123aueakwcvv.img {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:17:33 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Converted 1024.00 MB image at 103.99 MB/s Sep 28 15:17:33 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] 52f0399c-52b1-4949-9a0b-c671961d123a was raw, no need to convert to raw {{(pid=86888) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 28 15:17:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-cc3b61f0-0245-488d-a786-823b8c3e3b7b req-c6408423-1411-412e-ac61-a159b5ea1305 tempest-TestInstancesWithCinderVolumes-1970037286 None] Terminate volume connection completed successfully. Sep 28 15:17:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-cc3b61f0-0245-488d-a786-823b8c3e3b7b req-c6408423-1411-412e-ac61-a159b5ea1305 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deleting attachment dc14f15d-c7d7-4ecc-a605-ef335b74da46. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "cinder-a3fe715e-f4b2-4573-81c3-6435900cba5a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-a3fe715e-f4b2-4573-81c3-6435900cba5a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "cinder-quobyte-a3fe715e-f4b2-4573-81c3-6435900cba5a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-quobyte-a3fe715e-f4b2-4573-81c3-6435900cba5a" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b179fc8-dc3c-4945-a696-93bd8965d0d2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:34 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a Sep 28 15:17:34 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:34 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a" returned: 0 in 0.588s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:34 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a Sep 28 15:17:34 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:35 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a3fe715e-f4b2-4573-81c3-6435900cba5a" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-quobyte-a3fe715e-f4b2-4573-81c3-6435900cba5a" released by "delete_volume" :: held 1.083s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:35 devstack cinder-volume[86888]: WARNING cinder.quota [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-910702382-1740617630 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-910702382-1740617630, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:17:35 devstack cinder-volume[86888]: WARNING cinder.quota [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-910702382-1740617630 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-910702382-1740617630, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Created reservations ['95b64e89-f2bc-48e6-9ff0-762b161c5d8e', '7f4eb32f-0fcf-4be7-be19-afe9f15400d6', 'f1acbde7-5adb-47f3-90b8-440ac12d9ebe', 'e04f1c4b-afa9-4f06-aff6-48c69f9ba8cf'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:35 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:17:35 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:36 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:36 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:36 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deleted volume successfully. Sep 28 15:17:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e783120-de4e-4c5f-b60c-39d3b912aa24 tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-a3fe715e-f4b2-4573-81c3-6435900cba5a-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:40 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:17:40 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-c90a7f97-e0f4-4340-881e-f55229174bea req-50a35966-653b-497f-b617-90f06bf90bc7 tempest-TestInstancesWithCinderVolumes-1970037286 None] Terminate volume connection completed successfully. Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-c90a7f97-e0f4-4340-881e-f55229174bea req-50a35966-653b-497f-b617-90f06bf90bc7 tempest-TestInstancesWithCinderVolumes-1970037286 None] Deleting attachment dd51b255-2077-483a-80d5-5b02ed7608a4. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:41 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.534s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Flow 'volume_create_manager' (40039681-15bc-4ac8-9dca-a20dadc41bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac0f124-f542-4472-9699-b76f5dfe78b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac0f124-f542-4472-9699-b76f5dfe78b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1729266154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b69c42a-5a97-42d8-ad0d-6875c418914a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2abff7e95f94683b318d5770598df07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:41Z,use_quota=True,user_id='4b53ef3939f14be4b2d31c33522c3a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c317a5-886d-4acd-8fe2-5e0faefff33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c317a5-886d-4acd-8fe2-5e0faefff33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70814ecf-281b-4b86-966c-dd052eeb29d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70814ecf-281b-4b86-966c-dd052eeb29d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b69c42a-5a97-42d8-ad0d-6875c418914a', 'volume_name': 'volume-3b69c42a-5a97-42d8-ad0d-6875c418914a', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb142fb7-9d25-4c7e-94ef-a5bd38c94ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb142fb7-9d25-4c7e-94ef-a5bd38c94ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67218af-be71-4c14-93ee-92a3939a8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Volume 3b69c42a-5a97-42d8-ad0d-6875c418914a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b69c42a-5a97-42d8-ad0d-6875c418914a', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:17:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Trying to clone 3b69c42a-5a97-42d8-ad0d-6875c418914a from image 014259cc-3d70-4b12-abe4-95d560fe7bff at location (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:17:42 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a339aa-614a-49e5-9ffb-a134483e3dd0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:42 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD Sep 28 15:17:42 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "cinder-ee40e93a-4009-4715-838e-469423bdfbc3-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-ee40e93a-4009-4715-838e-469423bdfbc3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:42 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff is fetched for user 4b53ef3939f14be4b2d31c33522c3a00. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "cinder-quobyte-ee40e93a-4009-4715-838e-469423bdfbc3" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-quobyte-ee40e93a-4009-4715-838e-469423bdfbc3" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332cc86-cbe3-4931-a748-6ce51106d88e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc7900-c6b0-456e-ae6d-012bba26d9b6]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:43 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD Sep 28 15:17:43 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:43 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:17:43 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:43 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:43 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 0 in 0.627s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:43 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:17:43 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 1 in 0.517s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3 Sep 28 15:17:44 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ee40e93a-4009-4715-838e-469423bdfbc3" returned: 0 in 0.373s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-quobyte-ee40e93a-4009-4715-838e-469423bdfbc3" released by "delete_volume" :: held 1.636s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:44 devstack cinder-volume[86888]: WARNING cinder.quota [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549123474-1300738972 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549123474-1300738972, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:17:44 devstack cinder-volume[86888]: WARNING cinder.quota [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549123474-1300738972 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1549123474-1300738972, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Created reservations ['ca489a41-58ff-4257-b0b8-1e69fd88c929', '5f0ec0b4-e99e-40ed-ba0d-5df647c25ad8', '4e3a2b02-6af6-4897-99e8-f17aabd0eae3', '3ebafbd5-c515-4bda-8c6b-a32540694492'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:17:44 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.374s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Deleted volume successfully. Sep 28 15:17:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a953e02a-3714-4724-afcb-3c9d6f6c73fe tempest-TestInstancesWithCinderVolumes-1970037286 None] Lock "cinder-ee40e93a-4009-4715-838e-469423bdfbc3-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:54 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=37,cinder:UPDATE=32,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:55 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=41,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.616s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Uploaded volume to glance image-id: 52f0399c-52b1-4949-9a0b-c671961d123a. {{(pid=86888) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.690s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1729266154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b69c42a-5a97-42d8-ad0d-6875c418914a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2abff7e95f94683b318d5770598df07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:41Z,use_quota=True,user_id='4b53ef3939f14be4b2d31c33522c3a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Creating volume 3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:18:00 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ea62824b-9180-48ea-8731-48aad207ca4b tempest-VolumesActionsTest-259442691 None] Copy volume to image completed successfully. Sep 28 15:18:00 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a 1073741824 Sep 28 15:18:00 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a 1073741824" returned: 0 in 0.678s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:18:00 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:01 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 0.308s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Attempting download of 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume 3b69c42a-5a97-42d8-ad0d-6875c418914a. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c7d64e-4548-426e-ae5f-06774ddf72da]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:01 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0 Sep 28 15:18:01 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:01 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0" returned: 0 in 0.472s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:01 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0 Sep 28 15:18:01 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:02 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0" returned: 1 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_dk8ck0j0' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d97f8e1-ff7f-4464-8cfe-7da51fa5b2ec]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:02 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD Sep 28 15:18:02 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:02 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] 014259cc-3d70-4b12-abe4-95d560fe7bff was qcow2, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:02 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:18:02 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ad69a1-44bf-46fb-b317-1a68ac74e54c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:03 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:18:03 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:03 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.562s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:03 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b48082-efdb-40ba-805a-455300575ded]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:03 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:18:03 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:04 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.603s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:04 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img Sep 28 15:18:04 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 2.708s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_w645roxgdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:18:05 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Converted 112.00 MB image at 41.32 MB/s Sep 28 15:18:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a 1G Sep 28 15:18:05 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:06 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a 1G" returned: 0 in 0.772s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6755d2a8-e14e-4bd6-9f77-58ebc62008cc]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:06 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:18:06 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:07 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 0.936s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:07 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:18:07 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:07 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 1 in 0.755s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Downloaded image 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume 3b69c42a-5a97-42d8-ad0d-6875c418914a successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff for user 4b53ef3939f14be4b2d31c33522c3a00 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Marking volume 3b69c42a-5a97-42d8-ad0d-6875c418914a as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Copying metadata from image 014259cc-3d70-4b12-abe4-95d560fe7bff to 3b69c42a-5a97-42d8-ad0d-6875c418914a. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:18:07 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Creating volume glance metadata for volume 3b69c42a-5a97-42d8-ad0d-6875c418914a backed by image 014259cc-3d70-4b12-abe4-95d560fe7bff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:18:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67218af-be71-4c14-93ee-92a3939a8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b69c42a-5a97-42d8-ad0d-6875c418914a', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6984848-e48e-49fc-94a7-0af5f4e2158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Volume volume-3b69c42a-5a97-42d8-ad0d-6875c418914a (3b69c42a-5a97-42d8-ad0d-6875c418914a): created successfully Sep 28 15:18:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6984848-e48e-49fc-94a7-0af5f4e2158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Flow 'volume_create_manager' (40039681-15bc-4ac8-9dca-a20dadc41bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-27b55f42-e94d-42ab-8279-9957cd63c120 tempest-TestShelveInstance-1200167114 None] Created volume successfully. Sep 28 15:18:12 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img" returned: 0 in 8.803s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:12 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d9de8-c7d3-43ca-8019-d41f6fecbc4a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:18:13 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:13 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.651s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:13 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912, size 1024.00 MB, duration 8.81 sec, destination /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:18:13 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Converted 1024.00 MB image at 116.29 MB/s Sep 28 15:18:13 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] 28445d05-8ff5-42a9-b4a0-8bb94451eec8 was raw, converting to qcow2 {{(pid=86888) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 28 15:18:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa70c2-77b3-49ad-9ba2-06de2a3dc8f6]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img Sep 28 15:18:13 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img Sep 28 15:18:14 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:14 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img" returned: 1 in 0.558s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t Sep 28 15:18:14 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:15 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t" returned: 0 in 0.366s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:15 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Image conversion details: src /opt/stack/data/cinder/conversion/84a5b021-6e45-4c1a-b854-00f015348912.temp_image.28445d05-8ff5-42a9-b4a0-8bb94451eec8wpcz6v_h.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:18:15 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 15:18:15 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab42958-6daa-4b35-9ab8-78bdd229665c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:15 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t Sep 28 15:18:15 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:15 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7cv8f10t" returned: 0 in 0.455s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.895s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:17 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Uploaded volume to glance image-id: 28445d05-8ff5-42a9-b4a0-8bb94451eec8. {{(pid=86888) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:18:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.352s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ec6897b7-faaa-4a8c-853c-9b5f08be621e tempest-VolumesActionsTest-259442691 None] Copy volume to image completed successfully. Sep 28 15:18:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[223c6aef-1a86-4ff5-9c32-e144521d9256]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:18 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:18:18 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:18 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 0.662s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:18 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:18:18 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Acquiring lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:19 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 1 in 0.751s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.497s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Acquiring lock "cinder-quobyte-84a5b021-6e45-4c1a-b854-00f015348912" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Lock "cinder-quobyte-84a5b021-6e45-4c1a-b854-00f015348912" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ca0e9-d063-4366-9ad0-175e00ae957b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-3b69c42a-5a97-42d8-ad0d-6875c418914a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1065f9e5-e9e8-475b-9b00-d4e9c5e6414c', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:18:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-0fa66e3a-2108-46c5-a2b7-1666a9c85854 req-e16af6ee-87aa-41d8-b693-0b5b573b8a42 tempest-TestShelveInstance-1200167114 None] attachment_update completed successfully. Sep 28 15:18:19 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:18:19 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:20 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.699s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:20 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912 Sep 28 15:18:20 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:20 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-84a5b021-6e45-4c1a-b854-00f015348912" returned: 0 in 0.372s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Lock "cinder-quobyte-84a5b021-6e45-4c1a-b854-00f015348912" released by "delete_volume" :: held 1.164s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Created reservations ['8721833c-330d-44bc-987f-6755cf3c4c67', '3fc51494-2853-44b4-bb79-5c6187a03ba7', '9b3b0286-2f74-4abf-b719-620afda066da', 'c2560a6d-513e-442c-90e9-1f83b011ae9f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:20 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:18:20 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:21 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:21 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Deleted volume successfully. Sep 28 15:18:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-198039df-d42d-496c-a419-c3fa4320792e tempest-VolumesActionsTest-259442691 None] Lock "cinder-84a5b021-6e45-4c1a-b854-00f015348912-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:30 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=17,cinder:INSERT=10,cinder:SELECT=19 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:38 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=23,cinder:UPDATE=13,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (35da1936-5e42-4ee4-90f2-6b6a5ba5919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8c1b90-3daa-44f6-9d94-4cf64a87575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8c1b90-3daa-44f6-9d94-4cf64a87575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-143245816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406fcfd1-8125-442a-92d9-1a092598e53d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:40Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370edcd6-bf98-479e-8362-58bd35089817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370edcd6-bf98-479e-8362-58bd35089817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c157eeab-ca64-488a-b78d-6b8d9d54bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c157eeab-ca64-488a-b78d-6b8d9d54bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406fcfd1-8125-442a-92d9-1a092598e53d', 'volume_name': 'volume-406fcfd1-8125-442a-92d9-1a092598e53d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c672565-9370-4638-8572-b2ee33c07d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c672565-9370-4638-8572-b2ee33c07d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9004ba0f-f7b7-4cc1-8fca-e529544d0860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Volume 406fcfd1-8125-442a-92d9-1a092598e53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406fcfd1-8125-442a-92d9-1a092598e53d', 'volume_size': 1} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-143245816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406fcfd1-8125-442a-92d9-1a092598e53d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:40Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Creating volume 406fcfd1-8125-442a-92d9-1a092598e53d {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:18:40 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:40 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d 1073741824 Sep 28 15:18:40 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:40 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:18:40 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d 1073741824" returned: 0 in 0.495s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:40 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d Sep 28 15:18:40 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:41 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:18:41 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d" returned: 0 in 0.318s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9004ba0f-f7b7-4cc1-8fca-e529544d0860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406fcfd1-8125-442a-92d9-1a092598e53d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2155e657-a760-46c0-95bb-2270d330361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Volume volume-406fcfd1-8125-442a-92d9-1a092598e53d (406fcfd1-8125-442a-92d9-1a092598e53d): created successfully Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2155e657-a760-46c0-95bb-2270d330361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (35da1936-5e42-4ee4-90f2-6b6a5ba5919c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-455bd9b1-0cd0-42d3-86d5-dbe1315ca4d8 tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (4f6e092a-9b73-4fe9-9cc9-5c1f1fd5f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e880ecda-540c-41b1-8167-1f94118f69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e880ecda-540c-41b1-8167-1f94118f69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1484237593',display_name='tempest-VolumesGetTest-Volume-768960563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cdd15e-61e4-4717-bbc1-f817cb3d549c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:43Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a77b855-2fe0-4c9e-ab56-9c55b2f1c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a77b855-2fe0-4c9e-ab56-9c55b2f1c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b1dd2e-7fcd-4589-8d7c-4854274f7152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b1dd2e-7fcd-4589-8d7c-4854274f7152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cdd15e-61e4-4717-bbc1-f817cb3d549c', 'volume_name': 'volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83391cd2-7c51-462b-b93d-183e4916505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83391cd2-7c51-462b-b93d-183e4916505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb9992f-37d8-4a74-8742-f597d392b5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:43 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Volume 93cdd15e-61e4-4717-bbc1-f817cb3d549c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c', 'volume_size': 1} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1484237593',display_name='tempest-VolumesGetTest-Volume-768960563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cdd15e-61e4-4717-bbc1-f817cb3d549c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:43Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Creating volume 93cdd15e-61e4-4717-bbc1-f817cb3d549c {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:18:43 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:18:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:43 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c 1073741824 Sep 28 15:18:43 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:44 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c 1073741824" returned: 0 in 0.766s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:44 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c Sep 28 15:18:44 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:44 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c" returned: 0 in 0.343s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb9992f-37d8-4a74-8742-f597d392b5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d21c9-64f2-4c8e-8719-3ce3be85a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:44 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Volume volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c (93cdd15e-61e4-4717-bbc1-f817cb3d549c): created successfully Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d21c9-64f2-4c8e-8719-3ce3be85a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (4f6e092a-9b73-4fe9-9cc9-5c1f1fd5f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9670f663-915c-473d-88b2-e6fcdd0a9879 tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:18:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-93cdd15e-61e4-4717-bbc1-f817cb3d549c-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Lock "cinder-93cdd15e-61e4-4717-bbc1-f817cb3d549c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-93cdd15e-61e4-4717-bbc1-f817cb3d549c" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-93cdd15e-61e4-4717-bbc1-f817cb3d549c" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:45 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[050473c9-1505-45d7-bcae-e1cafc09ea7b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c Sep 28 15:18:45 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c" returned: 0 in 0.455s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:46 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c Sep 28 15:18:46 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-93cdd15e-61e4-4717-bbc1-f817cb3d549c" returned: 0 in 0.311s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-93cdd15e-61e4-4717-bbc1-f817cb3d549c" released by "delete_volume" :: held 0.821s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Created reservations ['61fdc14d-7b3a-4a1e-b5bb-56ac8d6a5a03', '5d2d7c83-2005-4f60-8c02-2cbbe230f4ed', 'c5fbb122-afca-4a95-868e-d96b5654de12', 'ab4da6b8-895c-4bc6-bd09-7c3c2c83ab9c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:46 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:18:46 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-406fcfd1-8125-442a-92d9-1a092598e53d-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Lock "cinder-406fcfd1-8125-442a-92d9-1a092598e53d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-406fcfd1-8125-442a-92d9-1a092598e53d" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-406fcfd1-8125-442a-92d9-1a092598e53d" acquired by "delete_volume" :: waited 0.081s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2bd22-6c5b-4bb2-9e75-e82139c44242]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:47 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.480s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1e6becb9-cbfb-4b39-b939-b9904d654354 tempest-VolumesGetTest-1524166466 None] Lock "cinder-93cdd15e-61e4-4717-bbc1-f817cb3d549c-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:47 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d Sep 28 15:18:47 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:47 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d" returned: 0 in 0.602s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:47 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d Sep 28 15:18:47 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:48 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-406fcfd1-8125-442a-92d9-1a092598e53d" returned: 0 in 0.309s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-406fcfd1-8125-442a-92d9-1a092598e53d" released by "delete_volume" :: held 0.996s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Created reservations ['e9838fa7-dbe4-49be-aa98-799cbbecd24a', '2f0d67a2-d980-47db-b140-ed908c4b45b6', '14ce3b23-3a00-4f92-9f8d-897162c1efb4', '4168abe5-31d1-40e7-b19c-50888ec9690b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:48 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:18:48 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:48 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.299s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:18:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-728ba547-e3d9-4074-b427-25b85423b45c tempest-VolumesGetTest-1524166466 None] Lock "cinder-406fcfd1-8125-442a-92d9-1a092598e53d-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (0915f43d-c4a4-4659-9349-910746844419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f001b9-60f3-473c-b764-d3da54cfcae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f001b9-60f3-473c-b764-d3da54cfcae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2928785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8046cf4-6cb5-46b9-9281-4ecd066f8152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:50Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11447785-e71e-41ec-b2a9-1a971ca0aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11447785-e71e-41ec-b2a9-1a971ca0aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97993f1a-67cb-4fb2-940b-ee0a74e90153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97993f1a-67cb-4fb2-940b-ee0a74e90153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'volume_name': 'volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201d3cb2-e776-4ccc-92fd-65ab60c05f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201d3cb2-e776-4ccc-92fd-65ab60c05f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e958442f-dcda-4a6c-bc8e-037376c821eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:50 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Volume b8046cf4-6cb5-46b9-9281-4ecd066f8152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'volume_size': 1} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2928785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8046cf4-6cb5-46b9-9281-4ecd066f8152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:50Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Creating volume b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:18:50 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:18:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:50 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 1073741824 Sep 28 15:18:50 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:51 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 1073741824" returned: 0 in 0.659s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:51 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:18:51 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:51 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.324s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e958442f-dcda-4a6c-bc8e-037376c821eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4000568-380e-404b-aacd-06ef6afa0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:51 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Volume volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 (b8046cf4-6cb5-46b9-9281-4ecd066f8152): created successfully Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4000568-380e-404b-aacd-06ef6afa0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (0915f43d-c4a4-4659-9349-910746844419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6d033c56-ef2f-4f83-acf9-e970aff5d2c7 tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (033438ed-1a04-438f-bfd1-c58514316d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d445cc39-3786-4c5a-8b0f-1bcc13225dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d445cc39-3786-4c5a-8b0f-1bcc13225dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1033647604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b8046cf4-6cb5-46b9-9281-4ecd066f8152,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:53Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac91da82-6b76-4eec-adfd-972f30059f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac91da82-6b76-4eec-adfd-972f30059f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709ce969-737f-4cdc-8257-c279ffaaf29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709ce969-737f-4cdc-8257-c279ffaaf29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7', 'volume_name': 'volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7', 'volume_size': 1, 'source_volid': 'b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'source_volstatus': 'available'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e339ee1-a088-4d08-9e54-b012968de296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e339ee1-a088-4d08-9e54-b012968de296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a91f90e-e10b-4050-ba37-7067449d42c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:53 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Volume 9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7', 'volume_size': 1, 'source_volid': 'b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'source_volstatus': 'available'} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:53 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Cloning volume b8046cf4-6cb5-46b9-9281-4ecd066f8152 to volume 9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Creating offline snapshot 008e3116-567a-465a-8dc0-e5cf490639a0 of volume b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b02b77-84c5-49ff-91dd-a8c4c44442a7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:53 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:18:53 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:53 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.511s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:53 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 1G Sep 28 15:18:53 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:54 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 1G" returned: 0 in 0.632s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:54 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 Sep 28 15:18:54 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:55 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 is being set with open permissions: ugo+rw Sep 28 15:18:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:55 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 Sep 28 15:18:55 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0" returned: 0 in 0.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:55 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info Sep 28 15:18:55 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info" returned: 0 in 0.390s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:55 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info is being set with open permissions: ugo+rw Sep 28 15:18:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:55 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info Sep 28 15:18:55 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:56 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.info" returned: 0 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] snapshot: 008e3116-567a-465a-8dc0-e5cf490639a0, volume: 9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31236b-0ad6-4f95-8f70-cf72577aeab8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Flow 'volume_create_manager' (493d7d8c-7193-4aec-8ccd-7f32c5991065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0cec74-c60a-4a45-8bae-7d713e594a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0cec74-c60a-4a45-8bae-7d713e594a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1699977447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5145563f-a877-4cb4-8d94-8676be79f2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dbf1a023874534aa7aae121f4ee2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:56Z,use_quota=True,user_id='c9ea632c020c4395ad9700ee3c5697ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a6838c-1ac7-478c-9132-544c6d5aa011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a6838c-1ac7-478c-9132-544c6d5aa011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8530b42e-2f36-4e85-bddf-cb30677f3ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8530b42e-2f36-4e85-bddf-cb30677f3ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5145563f-a877-4cb4-8d94-8676be79f2c0', 'volume_name': 'volume-5145563f-a877-4cb4-8d94-8676be79f2c0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cb1bb8-608a-42ab-85ed-f9d0e5cb9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cb1bb8-608a-42ab-85ed-f9d0e5cb9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df0191-e3ee-4b86-a3f8-d00ffc6f0c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Volume 5145563f-a877-4cb4-8d94-8676be79f2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5145563f-a877-4cb4-8d94-8676be79f2c0', 'volume_size': 1} Sep 28 15:18:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:56 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 Sep 28 15:18:56 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0" returned: 0 in 0.596s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[33862145-fd7f-4aba-bd0c-1840b3d296f5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:18:57 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.517s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:18:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 Sep 28 15:18:57 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-8573f9cf-1b08-4ca4-b5fc-0cfb081a47cf req-2cd31e7b-55f6-41b9-81eb-9667e0962b45 tempest-TestShelveInstance-1200167114 None] Terminate volume connection completed successfully. Sep 28 15:19:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-8573f9cf-1b08-4ca4-b5fc-0cfb081a47cf req-2cd31e7b-55f6-41b9-81eb-9667e0962b45 tempest-TestShelveInstance-1200167114 None] Deleting attachment 1065f9e5-e9e8-475b-9b00-d4e9c5e6414c. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:19:06 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:08 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" returned: 0 in 10.698s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b689fc4-ed67-4897-bdea-54fec05821dc]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:08 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:19:08 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:08 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.591s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:19:08 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Converted 1024.00 MB image at 95.71 MB/s Sep 28 15:19:08 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 is being set with open permissions: ugo+rw Sep 28 15:19:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:08 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 Sep 28 15:19:08 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:09 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" returned: 0 in 0.298s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" released by "_copy_volume_from_snapshot" :: held 12.828s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-008e3116-567a-465a-8dc0-e5cf490639a0" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-008e3116-567a-465a-8dc0-e5cf490639a0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Deleting offline snapshot 008e3116-567a-465a-8dc0-e5cf490639a0 of volume b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] snapshot_file for this snap is: volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858fe85-5819-4ba6-b824-abcfdcfa7336]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:09 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 Sep 28 15:19:09 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:09 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0" returned: 0 in 0.390s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbde3bf-d797-4b00-9fe4-9a71fa9e7623]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:09 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:19:09 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:10 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.419s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:10 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 Sep 28 15:19:10 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:10 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0" returned: 0 in 0.384s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:10 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0 Sep 28 15:19:10 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:10 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152.008e3116-567a-465a-8dc0-e5cf490639a0" returned: 0 in 0.274s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-008e3116-567a-465a-8dc0-e5cf490639a0" released by "_delete_snapshot" :: held 1.589s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.570s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.272s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1699977447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5145563f-a877-4cb4-8d94-8676be79f2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dbf1a023874534aa7aae121f4ee2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:56Z,use_quota=True,user_id='c9ea632c020c4395ad9700ee3c5697ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Creating volume 5145563f-a877-4cb4-8d94-8676be79f2c0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:19:10 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:10 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 1073741824 Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a91f90e-e10b-4050-ba37-7067449d42c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7', 'volume_size': 1, 'source_volid': 'b8046cf4-6cb5-46b9-9281-4ecd066f8152', 'source_volstatus': 'available'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:10 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae41068-b899-4345-aade-af5ee9147770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Volume volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 (9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7): created successfully Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae41068-b899-4345-aade-af5ee9147770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (033438ed-1a04-438f-bfd1-c58514316d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d634dc56-e2d2-40bb-929c-b5c220b59c11 tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:19:11 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 1073741824" returned: 0 in 0.606s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:11 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 Sep 28 15:19:11 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:11 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0" returned: 0 in 0.286s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.803s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df0191-e3ee-4b86-a3f8-d00ffc6f0c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5145563f-a877-4cb4-8d94-8676be79f2c0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3af8bac-27e9-4f8d-a7dc-ee047da497a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Volume volume-5145563f-a877-4cb4-8d94-8676be79f2c0 (5145563f-a877-4cb4-8d94-8676be79f2c0): created successfully Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3af8bac-27e9-4f8d-a7dc-ee047da497a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Flow 'volume_create_manager' (493d7d8c-7193-4aec-8ccd-7f32c5991065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fdb16a-16cd-4d17-89ed-5c1eddab39e3]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a84e7c93-8923-43a9-b587-9a53c7a429ec tempest-TestMinimumBasicScenario-472712243 None] Created volume successfully. Sep 28 15:19:12 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:19:12 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (4655f37d-1506-4600-93d0-ab98adc9a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7a68b4-99e0-4ab9-b8e5-57d13e3f6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7a68b4-99e0-4ab9-b8e5-57d13e3f6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-274519883',display_name='tempest-VolumesGetTest-Volume-220181064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66c60aa-2c63-45b1-879f-79004b7687b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:12Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac1bb3d-71ae-4139-afbc-959b6a63977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac1bb3d-71ae-4139-afbc-959b6a63977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd53766e-57c6-41b4-ad13-3415109488de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd53766e-57c6-41b4-ad13-3415109488de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66c60aa-2c63-45b1-879f-79004b7687b7', 'volume_name': 'volume-a66c60aa-2c63-45b1-879f-79004b7687b7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffa123d-ba8f-479f-ba0d-0e2b903a16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffa123d-ba8f-479f-ba0d-0e2b903a16f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7132bb4f-abdf-4729-83ca-4ea29b32766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:12 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Volume a66c60aa-2c63-45b1-879f-79004b7687b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66c60aa-2c63-45b1-879f-79004b7687b7', 'volume_size': 1} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:12 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 0.476s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:12 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:19:12 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:12 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 1 in 0.454s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-274519883',display_name='tempest-VolumesGetTest-Volume-220181064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66c60aa-2c63-45b1-879f-79004b7687b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:12Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Creating volume a66c60aa-2c63-45b1-879f-79004b7687b7 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:19:12 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:12 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 1073741824 Sep 28 15:19:12 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-3b69c42a-5a97-42d8-ad0d-6875c418914a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e58453b7-6601-446f-9f0d-cfd4a9fbccb2', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:19:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-2bbc9f0c-9f1f-4de8-9b2a-ab0dad948273 req-8b635a87-c1e9-4a8b-8d83-a78a48919bc3 tempest-TestShelveInstance-1200167114 None] attachment_update completed successfully. Sep 28 15:19:13 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 1073741824" returned: 0 in 0.871s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:13 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 Sep 28 15:19:13 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:14 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7" returned: 0 in 0.363s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.131s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7132bb4f-abdf-4729-83ca-4ea29b32766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66c60aa-2c63-45b1-879f-79004b7687b7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e9111e-f579-43cc-b7d8-88b7341877bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0293188e-bd83-4310-a681-a9cc95b401f0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Volume volume-a66c60aa-2c63-45b1-879f-79004b7687b7 (a66c60aa-2c63-45b1-879f-79004b7687b7): created successfully Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e9111e-f579-43cc-b7d8-88b7341877bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (4655f37d-1506-4600-93d0-ab98adc9a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-357db973-5b1e-4691-aea6-9f28fc6ed37d tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:19:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 Sep 28 15:19:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-a66c60aa-2c63-45b1-879f-79004b7687b7-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Lock "cinder-a66c60aa-2c63-45b1-879f-79004b7687b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-a66c60aa-2c63-45b1-879f-79004b7687b7" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-a66c60aa-2c63-45b1-879f-79004b7687b7" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a2dbe-bb1e-49fd-aac9-0fcd9a9e4b01]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:14 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0" returned: 0 in 0.590s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.632s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b', 'name': 'volume-5145563f-a877-4cb4-8d94-8676be79f2c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a48194e1-e908-4adf-835e-1f56d5e25137', 'enforce_multipath': True} {{(pid=86888) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:19:14 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 Sep 28 15:19:14 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:15 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-74429760-1d3e-4918-b91f-75641a559a8b req-16b2c155-9d63-437a-8655-666d78bac743 tempest-TestMinimumBasicScenario-472712243 None] attachment_update completed successfully. Sep 28 15:19:15 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7" returned: 0 in 0.612s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:15 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7 Sep 28 15:19:15 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:15 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a66c60aa-2c63-45b1-879f-79004b7687b7" returned: 0 in 0.349s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-a66c60aa-2c63-45b1-879f-79004b7687b7" released by "delete_volume" :: held 1.026s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Created reservations ['5992126a-70ef-4cb4-975c-52f12e28ec50', 'a2a74086-cb32-45e8-8983-f95ee935056a', 'bac7e3ca-5051-4a38-a27d-6a391a576e16', 'bf9fe142-1c81-44c8-8ab2-10d96954566b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:16 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:19:16 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:16 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.360s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:16 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:19:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-43f595b5-5cad-411c-8208-1c306cb911af tempest-VolumesGetTest-1524166466 None] Lock "cinder-a66c60aa-2c63-45b1-879f-79004b7687b7-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Lock "cinder-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" acquired by "delete_volume" :: waited 0.054s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc174118-087f-4bb9-a8fa-a104400e5d30]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:17 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 Sep 28 15:19:17 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:18 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" returned: 0 in 0.837s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:18 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7 Sep 28 15:19:18 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:18 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" returned: 0 in 0.497s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7" released by "delete_volume" :: held 1.413s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:18 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Created reservations ['9bd9dfe1-2fc7-4e9f-8381-fb84614583da', '639e9af5-e339-4ecb-a12a-711fde5af146', '19ae60da-2319-45c7-9de4-f542732b0d11', 'bf778e16-d4f2-4014-84ec-8e4e1c36bb3f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:19 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:19:19 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:19 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.330s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0a26852e-43a4-4c87-b22a-4de937bf98cf tempest-VolumesGetTest-1524166466 None] Lock "cinder-9e1d49ea-05b0-4d5d-b41b-3c132a8ac0f7-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-b8046cf4-6cb5-46b9-9281-4ecd066f8152-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Lock "cinder-b8046cf4-6cb5-46b9-9281-4ecd066f8152-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-b8046cf4-6cb5-46b9-9281-4ecd066f8152" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-b8046cf4-6cb5-46b9-9281-4ecd066f8152" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c7e209-e780-4d9b-a1a3-9e85e1e15705]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:20 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:19:20 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:20 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.494s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:20 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152 Sep 28 15:19:20 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:20 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b8046cf4-6cb5-46b9-9281-4ecd066f8152" returned: 0 in 0.305s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-b8046cf4-6cb5-46b9-9281-4ecd066f8152" released by "delete_volume" :: held 0.941s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:20 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Created reservations ['d155194c-7b51-4950-a542-1507ccebbb81', '33c8f018-b7e6-4cf2-9e0a-5da2bdddbaca', '41540ac0-a402-4756-a167-7e7f2a91fd59', '3dbcf912-ab88-4dae-b37e-5d1d5cc7f7c2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:21 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:19:21 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:21 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.392s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:19:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-966a00ae-32fa-40a0-a43a-aaa50c5d6fed tempest-VolumesGetTest-1524166466 None] Lock "cinder-b8046cf4-6cb5-46b9-9281-4ecd066f8152-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (f1229165-06fa-471a-8bcc-3a4f0d38c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ddb3fe-474d-4d7a-8512-7fc6c2b0c40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ddb3fe-474d-4d7a-8512-7fc6c2b0c40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1938386776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1313f5-9c8a-461a-80bd-da8fb16938f8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:22Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd023c53-a42c-41df-8916-dcfbaf72d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd023c53-a42c-41df-8916-dcfbaf72d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5e75bd-4f3e-48c9-932d-7e256a58af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:19:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5e75bd-4f3e-48c9-932d-7e256a58af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b1313f5-9c8a-461a-80bd-da8fb16938f8', 'volume_name': 'volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b0919d-0cab-450d-b2d1-d9d86b123a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b0919d-0cab-450d-b2d1-d9d86b123a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57839a25-e33c-4252-a1ff-f12ed398ad9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Volume 3b1313f5-9c8a-461a-80bd-da8fb16938f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Trying to clone 3b1313f5-9c8a-461a-80bd-da8fb16938f8 from image 014259cc-3d70-4b12-abe4-95d560fe7bff at location (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:19:23 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba0f4a-5497-4ec1-8f4c-61d1b9b3f189]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:23 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD Sep 28 15:19:23 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:24 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff is fetched for user 4029660731be4b32b951313cbc31168b. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[685614ce-b7b2-4aa7-800b-e8eb24ce9bc1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:24 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD Sep 28 15:19:24 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:24 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1938386776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1313f5-9c8a-461a-80bd-da8fb16938f8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:22Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Creating volume 3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:19:24 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:19:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:24 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 1073741824 Sep 28 15:19:24 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:25 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 1073741824" returned: 0 in 0.626s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:25 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:25 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:25 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 0 in 0.357s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Attempting download of 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume 3b1313f5-9c8a-461a-80bd-da8fb16938f8. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e9889-78a1-4f76-8e65-5332584432f6]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:25 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4 Sep 28 15:19:25 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:26 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4" returned: 0 in 0.425s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:26 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4 Sep 28 15:19:26 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:26 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4" returned: 1 in 0.480s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_014259cc-3d70-4b12-abe4-95d560fe7bff_ba8tsya4' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:19:26 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e8974-e508-415c-b1bf-21f31ea52383]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:26 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD Sep 28 15:19:26 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:27 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:27 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] 014259cc-3d70-4b12-abe4-95d560fe7bff was qcow2, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:19:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:27 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:27 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:29 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 0 in 1.825s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_014259cc-3d70-4b12-abe4-95d560fe7bff_0y5xhurcdevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:19:29 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Converted 112.00 MB image at 61.31 MB/s Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:29 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 1G Sep 28 15:19:29 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:29 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 1G" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e6d5df-14e0-476c-b553-a3f22a9dad5a]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:29 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:29 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:29 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 0 in 0.361s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:29 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:29 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:30 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 1 in 0.367s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Downloaded image 014259cc-3d70-4b12-abe4-95d560fe7bff ((None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}])) to volume 3b1313f5-9c8a-461a-80bd-da8fb16938f8 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Temporary image 014259cc-3d70-4b12-abe4-95d560fe7bff for user 4029660731be4b32b951313cbc31168b is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Marking volume 3b1313f5-9c8a-461a-80bd-da8fb16938f8 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Copying metadata from image 014259cc-3d70-4b12-abe4-95d560fe7bff to 3b1313f5-9c8a-461a-80bd-da8fb16938f8. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Creating volume glance metadata for volume 3b1313f5-9c8a-461a-80bd-da8fb16938f8 backed by image 014259cc-3d70-4b12-abe4-95d560fe7bff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57839a25-e33c-4252-a1ff-f12ed398ad9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8', 'volume_size': 1, 'image_id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/014259cc-3d70-4b12-abe4-95d560fe7bff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56b0e42f86764fcfa97ea3382d240829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '014259cc-3d70-4b12-abe4-95d560fe7bff', 'created_at': datetime.datetime(2026, 9, 28, 12, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/014259cc-3d70-4b12-abe4-95d560fe7bff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba89da71-3aa6-4af4-af90-8c832dbe8e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:30 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Volume volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 (3b1313f5-9c8a-461a-80bd-da8fb16938f8): created successfully Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba89da71-3aa6-4af4-af90-8c832dbe8e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (f1229165-06fa-471a-8bcc-3a4f0d38c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e7b957a2-baa5-4fcd-aa7d-8f4ac45dc425 tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=64,cinder:UPDATE=63,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (6137398a-6669-4cdb-9007-f5c6c055d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4bc8d4-8c1a-407a-87fc-fcf0b27091a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4bc8d4-8c1a-407a-87fc-fcf0b27091a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-669167331',display_name='tempest-VolumesGetTest-Volume-1229910066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6b22d0-49b8-4c28-b2c5-1d693fc4e802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:32Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fa5c25-d394-44db-a1ae-d7869c20ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fa5c25-d394-44db-a1ae-d7869c20ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89b6376-9155-48f1-9262-ea8bb2c86db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89b6376-9155-48f1-9262-ea8bb2c86db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6b22d0-49b8-4c28-b2c5-1d693fc4e802', 'volume_name': 'volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1d2baf-e48f-4680-afc3-86f7958da733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1d2baf-e48f-4680-afc3-86f7958da733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e0512f-004c-4b2f-ab68-9ea446d175db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Volume ad6b22d0-49b8-4c28-b2c5-1d693fc4e802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802', 'volume_size': 1} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-669167331',display_name='tempest-VolumesGetTest-Volume-1229910066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6b22d0-49b8-4c28-b2c5-1d693fc4e802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea635ffae56407081ac26ce923082be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:32Z,use_quota=True,user_id='4029660731be4b32b951313cbc31168b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Creating volume ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:19:31 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:19:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:31 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 1073741824 Sep 28 15:19:31 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:32 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 1073741824" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:32 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 Sep 28 15:19:32 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:32 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e0512f-004c-4b2f-ab68-9ea446d175db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca4b6e3-ecf4-44b8-8408-75a5bdfde2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Volume volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 (ad6b22d0-49b8-4c28-b2c5-1d693fc4e802): created successfully Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca4b6e3-ecf4-44b8-8408-75a5bdfde2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Flow 'volume_create_manager' (6137398a-6669-4cdb-9007-f5c6c055d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-958459a6-a304-48e5-b9fb-0084cc419986 tempest-VolumesGetTest-1524166466 None] Created volume successfully. Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Lock "cinder-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d66876-7bc7-4e01-885d-db3253d35dcd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:34 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 Sep 28 15:19:34 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:34 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:34 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802 Sep 28 15:19:34 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:34 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802" returned: 0 in 0.281s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802" released by "delete_volume" :: held 0.725s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:34 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Created reservations ['9b3768a7-3515-418e-b3a0-6873acbca6cb', 'f8695125-62b1-4eb1-a933-6c3bd015a6c0', 'd7969d1d-51b4-4eaa-b868-0b8d14ba0e50', '6c5780ec-d3b5-47fe-b708-92e688dab7e2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:35 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:19:35 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-3b1313f5-9c8a-461a-80bd-da8fb16938f8-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:35 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.347s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Lock "cinder-3b1313f5-9c8a-461a-80bd-da8fb16938f8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c8db500-cce6-4251-9410-9b104f2e5ac4 tempest-VolumesGetTest-1524166466 None] Lock "cinder-ad6b22d0-49b8-4c28-b2c5-1d693fc4e802-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Acquiring lock "cinder-quobyte-3b1313f5-9c8a-461a-80bd-da8fb16938f8" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-3b1313f5-9c8a-461a-80bd-da8fb16938f8" acquired by "delete_volume" :: waited 0.013s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11720c8-6c95-4ba4-928f-bd442c67486f]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:35 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:35 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:35 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 0 in 0.348s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:36 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:36 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:36 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 1 in 0.343s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:36 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8 Sep 28 15:19:36 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:36 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b1313f5-9c8a-461a-80bd-da8fb16938f8" returned: 0 in 0.278s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Lock "cinder-quobyte-3b1313f5-9c8a-461a-80bd-da8fb16938f8" released by "delete_volume" :: held 1.062s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Created reservations ['4fc38f80-761a-4901-a4dd-ef861024f653', '9bc3c2f4-eb61-4842-935a-4153c1d22339', '6e0f0dc2-6402-4c27-a76b-0fac0374d547', 'daba5547-1ef3-45f7-b0a5-95d94e9a9de3'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:36 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:19:36 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:37 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.277s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:37 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Deleted volume successfully. Sep 28 15:19:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1411c14a-f6f0-47d4-b266-249d74c10555 tempest-VolumesGetTest-1524166466 None] Lock "cinder-3b1313f5-9c8a-461a-80bd-da8fb16938f8-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:40 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:19:40 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:41 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.402s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:19:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Flow 'volume_create_manager' (3e276a26-0e0a-4a9d-84c7-9cc00415a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c5b7d3-b533-483c-b045-bbad16c647b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c5b7d3-b533-483c-b045-bbad16c647b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-897242462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b60719-b96e-427a-84cf-e2192ebcca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0687be8e6f13440bb48a379114adeedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:46Z,use_quota=True,user_id='2639f091c14a40e4acb11f327c6db183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd5a6b8-00a6-45bc-a72e-39ccf8c0e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd5a6b8-00a6-45bc-a72e-39ccf8c0e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a28214-4a98-4486-a50a-adb11761a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a28214-4a98-4486-a50a-adb11761a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b60719-b96e-427a-84cf-e2192ebcca40', 'volume_name': 'volume-b2b60719-b96e-427a-84cf-e2192ebcca40', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003f201e-1909-46e0-9aad-1159cb6609dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003f201e-1909-46e0-9aad-1159cb6609dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bccb4ae-9843-43d7-b408-cb9f79021beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Volume b2b60719-b96e-427a-84cf-e2192ebcca40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b60719-b96e-427a-84cf-e2192ebcca40', 'volume_size': 1} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-897242462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b60719-b96e-427a-84cf-e2192ebcca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0687be8e6f13440bb48a379114adeedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:46Z,use_quota=True,user_id='2639f091c14a40e4acb11f327c6db183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Creating volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:19:46 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:46 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 1073741824 Sep 28 15:19:46 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:46 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 1073741824" returned: 0 in 0.472s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:46 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 Sep 28 15:19:46 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:47 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40" returned: 0 in 0.300s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bccb4ae-9843-43d7-b408-cb9f79021beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b60719-b96e-427a-84cf-e2192ebcca40', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed08ecf-c6e8-4e24-ac98-67e0eab45af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Volume volume-b2b60719-b96e-427a-84cf-e2192ebcca40 (b2b60719-b96e-427a-84cf-e2192ebcca40): created successfully Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed08ecf-c6e8-4e24-ac98-67e0eab45af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Flow 'volume_create_manager' (3e276a26-0e0a-4a9d-84c7-9cc00415a875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5f938ee6-cceb-4bed-b4ee-6885cc160058 tempest-VolumesSnapshotListTestJSON-1991409339 None] Created volume successfully. Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Creating offline snapshot 36ab9141-ede1-479f-839f-68b93ebeb63b of volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b36b94-f540-44c7-91b7-863d7e0581b0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:48 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 Sep 28 15:19:48 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:48 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40" returned: 0 in 0.365s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:48 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b 1G Sep 28 15:19:48 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:49 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b 1G" returned: 0 in 0.427s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:49 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:19:49 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:49 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.310s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:49 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b is being set with open permissions: ugo+rw Sep 28 15:19:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:49 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:19:49 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:49 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.277s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:49 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info Sep 28 15:19:49 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:50 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info" returned: 0 in 0.264s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:50 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info is being set with open permissions: ugo+rw Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:50 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info Sep 28 15:19:50 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:50 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.info" returned: 0 in 0.236s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:50 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2ac5e6aa-da7d-45ed-ba62-b61d35a9eb86 tempest-VolumesSnapshotListTestJSON-1991409339 None] Create snapshot completed successfully Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Creating offline snapshot a5180d15-9a36-45f8-b4f1-c8d32a297476 of volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796947f-2404-440f-9314-441ea7351592]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:50 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:19:50 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:51 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:51 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 1G Sep 28 15:19:51 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:51 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 1G" returned: 0 in 0.465s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:51 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:19:51 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:51 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.314s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:51 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 is being set with open permissions: ugo+rw Sep 28 15:19:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:52 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:19:52 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:52 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.288s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.590s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-943c7769-2854-4f32-9c5c-6071800d9880 tempest-VolumesSnapshotListTestJSON-1991409339 None] Create snapshot completed successfully Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Creating offline snapshot 43be357d-6f65-471f-b54e-4170f354f7db of volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f1464-541c-4ada-8573-d946d66cf4d9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:53 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:19:53 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:53 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.426s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:53 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db 1G Sep 28 15:19:53 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:54 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db 1G" returned: 0 in 0.591s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:54 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db Sep 28 15:19:54 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:54 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db" returned: 0 in 0.392s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:54 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db is being set with open permissions: ugo+rw Sep 28 15:19:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:54 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db Sep 28 15:19:54 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:54 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db" returned: 0 in 0.258s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a14b9cba-dcf4-4a69-a237-bcce678ea644 tempest-VolumesSnapshotListTestJSON-1991409339 None] Create snapshot completed successfully Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-43be357d-6f65-471f-b54e-4170f354f7db-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-43be357d-6f65-471f-b54e-4170f354f7db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-43be357d-6f65-471f-b54e-4170f354f7db" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-43be357d-6f65-471f-b54e-4170f354f7db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Deleting offline snapshot 43be357d-6f65-471f-b54e-4170f354f7db of volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] snapshot_file for this snap is: volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2775cb-e9ff-4ba2-8a4a-617fb100d8bd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:56 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db Sep 28 15:19:56 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:56 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db" returned: 0 in 0.409s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbfdc15-dd67-464d-a2ca-09c0aa495bd6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:56 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:19:56 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:57 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:57 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db Sep 28 15:19:57 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:57 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db" returned: 0 in 0.419s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:57 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db Sep 28 15:19:57 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:57 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.43be357d-6f65-471f-b54e-4170f354f7db" returned: 0 in 0.304s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-43be357d-6f65-471f-b54e-4170f354f7db" released by "_delete_snapshot" :: held 1.669s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" released by "delete_snapshot" :: held 1.696s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Created reservations ['b956ec00-c496-4015-9fc0-93f8e6b3e2d5', '33a53e64-b1aa-4c1c-9265-0349073bb38d', '3645c436-dd84-4e2b-a8e7-165d9189349b', '28ec0920-a5b4-4766-be85-2f8416c72e9e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Delete snapshot completed successfully. Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6181e4fb-9d34-421b-bf5d-45ca051542c2 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-43be357d-6f65-471f-b54e-4170f354f7db-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-a5180d15-9a36-45f8-b4f1-c8d32a297476-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-a5180d15-9a36-45f8-b4f1-c8d32a297476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-a5180d15-9a36-45f8-b4f1-c8d32a297476" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-a5180d15-9a36-45f8-b4f1-c8d32a297476" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Deleting offline snapshot a5180d15-9a36-45f8-b4f1-c8d32a297476 of volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] snapshot_file for this snap is: volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1684f5ba-3619-4f80-b045-4b877ef12854]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:58 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:19:58 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:58 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.475s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c3b81-0453-46aa-8c15-ad1235fb1b90]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:59 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:19:59 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:59 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.500s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:59 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:19:59 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:00 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.525s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:00 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476 Sep 28 15:20:00 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:00 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.a5180d15-9a36-45f8-b4f1-c8d32a297476" returned: 0 in 0.292s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-a5180d15-9a36-45f8-b4f1-c8d32a297476" released by "_delete_snapshot" :: held 1.968s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" released by "delete_snapshot" :: held 1.994s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Created reservations ['cb80d309-b6e3-4502-be0a-57ecd605db0e', '86a2d0dc-4883-4f67-ae24-564037b8d7af', '4df48432-bec1-4cda-a3ab-643aa57cb85b', '517d8f81-c861-46c3-aeda-b1a42a2a8ec8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Delete snapshot completed successfully. Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-dcb2e74b-110d-4ee8-87d6-f06bc7b7d96a tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-a5180d15-9a36-45f8-b4f1-c8d32a297476-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-00874156-ff3b-489b-aa10-f660ed2b3ed5 tempest-TestShelveInstance-1200167114 None] Terminate volume connection completed successfully. Sep 28 15:20:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-00874156-ff3b-489b-aa10-f660ed2b3ed5 tempest-TestShelveInstance-1200167114 None] Deleting attachment e58453b7-6601-446f-9f0d-cfd4a9fbccb2. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Acquiring lock "cinder-3b69c42a-5a97-42d8-ad0d-6875c418914a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Lock "cinder-3b69c42a-5a97-42d8-ad0d-6875c418914a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Acquiring lock "cinder-quobyte-3b69c42a-5a97-42d8-ad0d-6875c418914a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Lock "cinder-quobyte-3b69c42a-5a97-42d8-ad0d-6875c418914a" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabee568-a226-4744-8f06-c730c0b50973]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:01 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:20:01 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-36ab9141-ede1-479f-839f-68b93ebeb63b-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-36ab9141-ede1-479f-839f-68b93ebeb63b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-36ab9141-ede1-479f-839f-68b93ebeb63b" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-36ab9141-ede1-479f-839f-68b93ebeb63b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Deleting offline snapshot 36ab9141-ede1-479f-839f-68b93ebeb63b of volume b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] snapshot_file for this snap is: volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c776b9b-79bf-42c5-aa53-c8514947b1b0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:01 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 0.499s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:01 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:20:01 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:01 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:20:01 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:02 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 1 in 0.404s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:02 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a Sep 28 15:20:02 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:02 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.473s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b60719-b96e-427a-84cf-e2192ebcca40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5e860c-7aa0-421e-8259-fb840156b821]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:02 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 Sep 28 15:20:02 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:02 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b69c42a-5a97-42d8-ad0d-6875c418914a" returned: 0 in 0.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Lock "cinder-quobyte-3b69c42a-5a97-42d8-ad0d-6875c418914a" released by "delete_volume" :: held 1.371s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG cinder.quota [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Created reservations ['4622e313-a363-40ad-adac-c30b47451445', 'f26df456-bc69-4160-9415-082d688cd884', '09130590-9d8d-4cd6-aab0-a72bb69612a2', 'ee910ad7-57bb-4180-8054-385e7c5fa040'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:02 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40" returned: 0 in 0.484s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:02 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:02 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:02 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:20:02 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:03 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.384s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG cinder.manager [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Deleted volume successfully. Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [req-66f5bfe4-2c05-4868-98ae-c125a57d7971 req-a9db57a3-9c25-498a-9b86-66138aacaf72 tempest-TestShelveInstance-1200167114 None] Lock "cinder-3b69c42a-5a97-42d8-ad0d-6875c418914a-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:03 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.615s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:03 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b Sep 28 15:20:03 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:03 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40.36ab9141-ede1-479f-839f-68b93ebeb63b" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-36ab9141-ede1-479f-839f-68b93ebeb63b" released by "_delete_snapshot" :: held 2.094s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" released by "delete_snapshot" :: held 2.126s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Created reservations ['8acb3857-8549-4518-af47-b956e739c6d4', '12ffad98-557f-4457-af26-96883ab22d88', '4030bd4e-cfa3-46fd-9ba7-726e26ec9b9d', '38f74889-fda3-46e8-8283-986de93a1a3e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Delete snapshot completed successfully. Sep 28 15:20:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6c8535d8-1fe9-49e0-9556-f41a387d3151 tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-36ab9141-ede1-479f-839f-68b93ebeb63b-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-b2b60719-b96e-427a-84cf-e2192ebcca40-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-b2b60719-b96e-427a-84cf-e2192ebcca40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[56456c03-7893-4d5d-9237-6690b00f64e8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:05 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 Sep 28 15:20:05 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:05 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40" returned: 0 in 0.404s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:05 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40 Sep 28 15:20:05 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:05 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b2b60719-b96e-427a-84cf-e2192ebcca40" returned: 0 in 0.321s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-quobyte-b2b60719-b96e-427a-84cf-e2192ebcca40" released by "delete_volume" :: held 0.802s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Created reservations ['2c544b14-b25b-430f-8d14-5930f6911683', 'a11d4eb3-46a8-426a-9cc8-1ed0afc01aa0', '217d1964-0182-4901-b002-4c23fb099796', '4ad2a6c1-b6b6-4e36-bf62-3f760ea44ddb'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:05 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:05 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:06 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.284s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:06 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Deleted volume successfully. Sep 28 15:20:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ed2003e8-085e-46f4-9df1-6baacbb7656d tempest-VolumesSnapshotListTestJSON-1991409339 None] Lock "cinder-b2b60719-b96e-427a-84cf-e2192ebcca40-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:11 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=83,cinder:UPDATE=95,cinder:DELETE=6,cinder:INSERT=33 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [req-f8b5c047-1a85-42be-81d4-5035fbd2e8e1 req-8ea2aaf1-344d-4dbd-9899-8aa8daebba2d tempest-TestMinimumBasicScenario-472712243 None] Terminate volume connection completed successfully. Sep 28 15:20:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [req-f8b5c047-1a85-42be-81d4-5035fbd2e8e1 req-8ea2aaf1-344d-4dbd-9899-8aa8daebba2d tempest-TestMinimumBasicScenario-472712243 None] Deleting attachment a48194e1-e908-4adf-835e-1f56d5e25137. {{(pid=86888) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:20:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Acquiring lock "cinder-5145563f-a877-4cb4-8d94-8676be79f2c0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Lock "cinder-5145563f-a877-4cb4-8d94-8676be79f2c0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Acquiring lock "cinder-quobyte-5145563f-a877-4cb4-8d94-8676be79f2c0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Lock "cinder-quobyte-5145563f-a877-4cb4-8d94-8676be79f2c0" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff237bb6-4676-43c4-8f73-36870042446f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:13 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 Sep 28 15:20:13 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:14 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0" returned: 0 in 0.632s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:14 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0 Sep 28 15:20:14 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:14 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5145563f-a877-4cb4-8d94-8676be79f2c0" returned: 0 in 0.325s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Lock "cinder-quobyte-5145563f-a877-4cb4-8d94-8676be79f2c0" released by "delete_volume" :: held 1.029s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Created reservations ['beaa8730-ab5a-42d7-87fd-dfc3bd4f3d79', 'd8c9a1d4-b521-4de0-97a8-b2e57f957132', '599b63f3-66fc-4a6c-a14c-6d22c1be8020', 'e432d860-7404-4d16-ad2b-8cea95b092b6'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:14 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:14 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:15 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.289s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:15 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:15 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Deleted volume successfully. Sep 28 15:20:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-09f3e4fa-baac-4fbd-a5a1-cd4e9d0f1c9a tempest-TestMinimumBasicScenario-472712243 None] Lock "cinder-5145563f-a877-4cb4-8d94-8676be79f2c0-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Flow 'volume_create_manager' (ff1ffc14-5e33-4241-8418-9db12bc84a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e6ebb-6936-4737-833c-691350d1143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e6ebb-6936-4737-833c-691350d1143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d64058-6592-4843-ab22-f6cc492740c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9cd10b4593498aaceced34bb189ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:16Z,use_quota=True,user_id='db1dfbb922d34401a56a8be092207066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d8a583-9a5c-4a68-bbf5-20946150deb3),volume_type_id=26d8a583-9a5c-4a68-bbf5-20946150deb3)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0cc0ea-6a8d-4289-881d-08e6bcc83219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0cc0ea-6a8d-4289-881d-08e6bcc83219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8528c0e-2f4f-4212-b36e-e5c9f574eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8528c0e-2f4f-4212-b36e-e5c9f574eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0d64058-6592-4843-ab22-f6cc492740c1', 'volume_name': 'volume-d0d64058-6592-4843-ab22-f6cc492740c1', 'volume_size': 1, 'image_id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a392efd198483147a2ff3c48fe3a1e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd9cd10b4593498aaceced34bb189ef7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '004a2b46a7c18e38a1c271bf20c52ae81f5dc174396525f81d8ba2d51f28508da6ab7bf721cabb403d22c8a2f2fd6a4e5c9a08f7259be5b16684f4ef5fcf61ba', 'id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'created_at': datetime.datetime(2026, 9, 28, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8b3d08-9488-413e-a116-179d3f9c076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8b3d08-9488-413e-a116-179d3f9c076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99baec8-87dc-4814-88e2-f207ad3e7316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:16 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Volume d0d64058-6592-4843-ab22-f6cc492740c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0d64058-6592-4843-ab22-f6cc492740c1', 'volume_size': 1, 'image_id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a392efd198483147a2ff3c48fe3a1e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd9cd10b4593498aaceced34bb189ef7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '004a2b46a7c18e38a1c271bf20c52ae81f5dc174396525f81d8ba2d51f28508da6ab7bf721cabb403d22c8a2f2fd6a4e5c9a08f7259be5b16684f4ef5fcf61ba', 'id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'created_at': datetime.datetime(2026, 9, 28, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Trying to clone d0d64058-6592-4843-ab22-f6cc492740c1 from image 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:20:16 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:20:16 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4718861a-1e79-47e6-bb06-30353367df16]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:17 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD Sep 28 15:20:17 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:17 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:17 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD Sep 28 15:20:17 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:17 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD" returned: 1 in 0.500s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:17 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Temporary image 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 is fetched for user db1dfbb922d34401a56a8be092207066. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:20:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd5acce-5c22-4fe2-bfd6-c53f22b70aa3]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:18 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD Sep 28 15:20:18 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:18 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:18 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD Sep 28 15:20:18 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:19 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD" returned: 1 in 0.496s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d64058-6592-4843-ab22-f6cc492740c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9cd10b4593498aaceced34bb189ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:16Z,use_quota=True,user_id='db1dfbb922d34401a56a8be092207066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d8a583-9a5c-4a68-bbf5-20946150deb3),volume_type_id=26d8a583-9a5c-4a68-bbf5-20946150deb3)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Creating volume d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:19 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:19 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 1073741824 Sep 28 15:20:19 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Flow 'volume_create_manager' (2a0bdd9e-753c-44ef-b93e-4adf43393611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca42c62-d26c-4104-8c17-bb772fec13c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:19 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca42c62-d26c-4104-8c17-bb772fec13c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b640317a-6a9b-4fd6-a0a6-5ba72836e448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93fb79b92e74ea2bebc9b592dba3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:20Z,use_quota=True,user_id='dc68215ec716447286cd002c743e199b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553a7ee8-565d-4072-8c71-13f5b4697846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553a7ee8-565d-4072-8c71-13f5b4697846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4658a101-18f1-4df2-95f5-34e46d54e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4658a101-18f1-4df2-95f5-34e46d54e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b640317a-6a9b-4fd6-a0a6-5ba72836e448', 'volume_name': 'volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bbf972-ee37-48d8-aef5-0f02af31007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bbf972-ee37-48d8-aef5-0f02af31007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e117cd83-0546-41a1-9370-902aed61a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:19 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Volume b640317a-6a9b-4fd6-a0a6-5ba72836e448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448', 'volume_size': 1} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 1073741824" returned: 0 in 0.734s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:19 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:19 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:20 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 0 in 0.296s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b640317a-6a9b-4fd6-a0a6-5ba72836e448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93fb79b92e74ea2bebc9b592dba3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:20Z,use_quota=True,user_id='dc68215ec716447286cd002c743e199b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Creating volume b640317a-6a9b-4fd6-a0a6-5ba72836e448 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:20 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:20 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 1073741824 Sep 28 15:20:20 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Attempting download of 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'metadata': {}}])) to volume d0d64058-6592-4843-ab22-f6cc492740c1. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[39edfdc8-f46a-466e-9c9e-69763e8f64c3]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:20 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97 Sep 28 15:20:20 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:20 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:20 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 1073741824" returned: 0 in 0.602s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97" returned: 0 in 0.466s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:20 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 Sep 28 15:20:20 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:20 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97 Sep 28 15:20:20 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:21 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97" returned: 1 in 0.342s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_mtvskl97' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f05e8c-65d3-494e-aa14-799ea1d5ef28]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:21 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448" returned: 0 in 0.332s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e117cd83-0546-41a1-9370-902aed61a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0425e-5a25-4ac0-b3f9-2b15d21b01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:21 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Volume volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 (b640317a-6a9b-4fd6-a0a6-5ba72836e448): created successfully Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0425e-5a25-4ac0-b3f9-2b15d21b01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:21 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD Sep 28 15:20:21 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Flow 'volume_create_manager' (2a0bdd9e-753c-44ef-b93e-4adf43393611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-72cb8e61-3859-4df6-b164-460b9bf83974 tempest-CinderUnicodeTest-1129327963 None] Created volume successfully. Sep 28 15:20:21 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:21 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD Sep 28 15:20:21 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:21 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 was raw, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:20:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:21 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:21 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:22 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 0 in 0.431s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a3d516b-51a9-46c3-bbc0-84c1e8e62985_ydwjxi27devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:20:22 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:22 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 1G Sep 28 15:20:22 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Flow 'volume_create_manager' (de0f866d-a390-41a8-9731-fb621f825e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32de1b89-6c70-4fd6-a989-4474d33aa34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32de1b89-6c70-4fd6-a989-4474d33aa34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1491055298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2207dff2-ed7e-47ec-9531-5ba0bdad7577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93fb79b92e74ea2bebc9b592dba3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:23Z,use_quota=True,user_id='dc68215ec716447286cd002c743e199b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f03d335-2197-4ead-9b67-0957531e6887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f03d335-2197-4ead-9b67-0957531e6887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03e9ca3-bc5d-45bf-af25-60428cba922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03e9ca3-bc5d-45bf-af25-60428cba922c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2207dff2-ed7e-47ec-9531-5ba0bdad7577', 'volume_name': 'volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d4d565-c3c3-4867-bfda-5b1f5e797716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d4d565-c3c3-4867-bfda-5b1f5e797716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b2ea9d-de39-4b78-8554-ca39e65d25c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:22 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Volume 2207dff2-ed7e-47ec-9531-5ba0bdad7577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577', 'volume_size': 1} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1491055298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2207dff2-ed7e-47ec-9531-5ba0bdad7577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93fb79b92e74ea2bebc9b592dba3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:23Z,use_quota=True,user_id='dc68215ec716447286cd002c743e199b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Creating volume 2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:22 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:22 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 1G" returned: 0 in 0.441s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:22 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 1073741824 Sep 28 15:20:22 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab110160-f436-47a7-81ae-2f51a85dda70]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:23 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:23 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:23 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 0 in 0.549s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:23 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 1073741824" returned: 0 in 0.642s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:23 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 Sep 28 15:20:23 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:23 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:23 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:23 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577" returned: 0 in 0.325s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b2ea9d-de39-4b78-8554-ca39e65d25c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6e6d4a-2937-48d7-9a9f-229c5ec7caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Volume volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 (2207dff2-ed7e-47ec-9531-5ba0bdad7577): created successfully Sep 28 15:20:23 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6e6d4a-2937-48d7-9a9f-229c5ec7caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Flow 'volume_create_manager' (de0f866d-a390-41a8-9731-fb621f825e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 1 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Downloaded image 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'metadata': {}}])) to volume d0d64058-6592-4843-ab22-f6cc492740c1 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Temporary image 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 for user db1dfbb922d34401a56a8be092207066 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Marking volume d0d64058-6592-4843-ab22-f6cc492740c1 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:20:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-28a60bb6-b2af-482a-a37a-fff136738107 tempest-CinderUnicodeTest-1129327963 None] Created volume successfully. Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Copying metadata from image 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 to d0d64058-6592-4843-ab22-f6cc492740c1. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Creating volume glance metadata for volume d0d64058-6592-4843-ab22-f6cc492740c1 backed by image 7a3d516b-51a9-46c3-bbc0-84c1e8e62985 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8a392efd198483147a2ff3c48fe3a1e9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99baec8-87dc-4814-88e2-f207ad3e7316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d64058-6592-4843-ab22-f6cc492740c1', 'volume_size': 1, 'image_id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a392efd198483147a2ff3c48fe3a1e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd9cd10b4593498aaceced34bb189ef7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '004a2b46a7c18e38a1c271bf20c52ae81f5dc174396525f81d8ba2d51f28508da6ab7bf721cabb403d22c8a2f2fd6a4e5c9a08f7259be5b16684f4ef5fcf61ba', 'id': '7a3d516b-51a9-46c3-bbc0-84c1e8e62985', 'created_at': datetime.datetime(2026, 9, 28, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a3d516b-51a9-46c3-bbc0-84c1e8e62985/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89841d8a-9a18-4613-9242-91f24b0f45eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Volume volume-d0d64058-6592-4843-ab22-f6cc492740c1 (d0d64058-6592-4843-ab22-f6cc492740c1): created successfully Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89841d8a-9a18-4613-9242-91f24b0f45eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Flow 'volume_create_manager' (ff1ffc14-5e33-4241-8418-9db12bc84a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9cdf9e5d-be2c-42df-af0e-cd06d2fcbfa5 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Created volume successfully. Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Acquiring lock "cinder-d0d64058-6592-4843-ab22-f6cc492740c1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "cinder-d0d64058-6592-4843-ab22-f6cc492740c1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Acquiring lock "cinder-quobyte-d0d64058-6592-4843-ab22-f6cc492740c1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "cinder-quobyte-d0d64058-6592-4843-ab22-f6cc492740c1" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06d2e92-95b0-416f-84d8-e3d153668537]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Creating offline snapshot 8b92d36e-791c-426e-a69a-b96c9fda1ac7 of volume 2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e76d4b-f2cb-403c-a5dc-a1234e7d9fb1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:25 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:25 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:25 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 Sep 28 15:20:25 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:25 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 0 in 0.587s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:25 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577" returned: 0 in 0.531s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:25 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:25 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:25 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 1G Sep 28 15:20:25 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:25 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 1 in 0.436s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:20:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:26 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1 Sep 28 15:20:26 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:26 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 1G" returned: 0 in 0.569s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:26 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 Sep 28 15:20:26 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:26 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d0d64058-6592-4843-ab22-f6cc492740c1" returned: 0 in 0.323s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "cinder-quobyte-d0d64058-6592-4843-ab22-f6cc492740c1" released by "delete_volume" :: held 1.438s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:26 devstack cinder-volume[86888]: WARNING cinder.quota [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:20:26 devstack cinder-volume[86888]: WARNING cinder.quota [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Created reservations ['36dad089-5ca7-4efe-ba87-6295fdf30cbf', '748cda02-82bb-4467-ab7b-8510993f3469', '873c6aa9-b54d-4b81-a0b6-52c3c0409fa4', 'a9881180-3f95-4893-aba6-cd8bcb8d0d28'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:26 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:26 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:26 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7" returned: 0 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:26 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 is being set with open permissions: ugo+rw Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:26 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 Sep 28 15:20:26 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:26 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.286s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Deleted volume successfully. Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c2af3391-f3e5-4d26-b626-913123019008 tempest-VolumeAndVolumeTypeFromImageTest-2029188710 None] Lock "cinder-d0d64058-6592-4843-ab22-f6cc492740c1-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:26 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7" returned: 0 in 0.325s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:26 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info Sep 28 15:20:26 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:27 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info" returned: 0 in 0.348s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:27 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info is being set with open permissions: ugo+rw Sep 28 15:20:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:27 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info Sep 28 15:20:27 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:27 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.info" returned: 0 in 0.307s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-da420593-d185-4eff-acdc-ba1395674460 tempest-CinderUnicodeTest-1129327963 None] Create snapshot completed successfully Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-8b92d36e-791c-426e-a69a-b96c9fda1ac7-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-8b92d36e-791c-426e-a69a-b96c9fda1ac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-quobyte-2207dff2-ed7e-47ec-9531-5ba0bdad7577" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-2207dff2-ed7e-47ec-9531-5ba0bdad7577" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-quobyte-8b92d36e-791c-426e-a69a-b96c9fda1ac7" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-8b92d36e-791c-426e-a69a-b96c9fda1ac7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Deleting offline snapshot 8b92d36e-791c-426e-a69a-b96c9fda1ac7 of volume 2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] snapshot_file for this snap is: volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be4ee4-bccb-4672-9d90-3f396649b6dd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:28 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 Sep 28 15:20:28 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:28 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7" returned: 0 in 0.477s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217422a-3c74-4c4a-bf69-cfe708298eb8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:29 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 Sep 28 15:20:29 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:29 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577" returned: 0 in 0.500s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:29 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 Sep 28 15:20:29 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:30 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:30 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7 Sep 28 15:20:30 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:30 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577.8b92d36e-791c-426e-a69a-b96c9fda1ac7" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-8b92d36e-791c-426e-a69a-b96c9fda1ac7" released by "_delete_snapshot" :: held 2.124s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-2207dff2-ed7e-47ec-9531-5ba0bdad7577" released by "delete_snapshot" :: held 2.152s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Created reservations ['4fad9075-4ea4-4fb9-bfeb-697f200821f7', '095be6fa-7719-47da-9976-69494612de66', '257a9fca-024d-41db-9213-8b80728a2c4a', 'b43ec5e7-be7c-4171-98ea-4b981817bfc0'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Delete snapshot completed successfully. Sep 28 15:20:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9131f55c-ee0d-42c8-bba7-dd280c2007ad tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-8b92d36e-791c-426e-a69a-b96c9fda1ac7-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-2207dff2-ed7e-47ec-9531-5ba0bdad7577-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-2207dff2-ed7e-47ec-9531-5ba0bdad7577-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-quobyte-2207dff2-ed7e-47ec-9531-5ba0bdad7577" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-2207dff2-ed7e-47ec-9531-5ba0bdad7577" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6894cb4-9eb0-4715-84de-4a3e7819d5f0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:31 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 Sep 28 15:20:31 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:32 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577" returned: 0 in 0.470s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:32 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577 Sep 28 15:20:32 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:32 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-2207dff2-ed7e-47ec-9531-5ba0bdad7577" returned: 0 in 0.359s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-2207dff2-ed7e-47ec-9531-5ba0bdad7577" released by "delete_volume" :: held 0.932s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=81,cinder:UPDATE=102,cinder:INSERT=28,cinder:DELETE=10 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Created reservations ['f06daccb-bf54-4c61-8550-838625987336', '9b937fc4-5f8f-4b5a-8a3c-f345c89cb3d2', '01dfea85-c107-4015-9f63-b7227961a3f0', 'b18d716b-5c61-4ebb-893d-a9c81c9c1016'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:32 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:32 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:33 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Deleted volume successfully. Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0b6460db-bfcc-4fdc-b192-3a8b1853f44c tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-2207dff2-ed7e-47ec-9531-5ba0bdad7577-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (ea978100-cfc3-44ab-a996-4cb6bcadd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5582c39c-aabf-4cab-910c-eb056fab695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5582c39c-aabf-4cab-910c-eb056fab695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871732862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a31710a-bb32-4129-a960-8d9dd9d35cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:34Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b49fbe4-933c-4da7-bd40-dbe7cd46649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b49fbe4-933c-4da7-bd40-dbe7cd46649e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d165c7d-0c4f-4088-be30-db1494e1ee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d165c7d-0c4f-4088-be30-db1494e1ee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a31710a-bb32-4129-a960-8d9dd9d35cd6', 'volume_name': 'volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d31663-ed56-4822-8cc0-a657629383be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d31663-ed56-4822-8cc0-a657629383be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04ceacb-f2c9-47eb-9402-af8701acbe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume 6a31710a-bb32-4129-a960-8d9dd9d35cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6', 'volume_size': 1} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871732862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a31710a-bb32-4129-a960-8d9dd9d35cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:34Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Creating volume 6a31710a-bb32-4129-a960-8d9dd9d35cd6 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:33 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:33 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 1073741824 Sep 28 15:20:33 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-b640317a-6a9b-4fd6-a0a6-5ba72836e448-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-b640317a-6a9b-4fd6-a0a6-5ba72836e448-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "cinder-quobyte-b640317a-6a9b-4fd6-a0a6-5ba72836e448" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-b640317a-6a9b-4fd6-a0a6-5ba72836e448" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4596c01-f8e3-4724-95a0-60010fded3ec]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:34 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 Sep 28 15:20:34 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 1073741824" returned: 0 in 0.643s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:34 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 Sep 28 15:20:34 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448" returned: 0 in 0.518s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:34 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448 Sep 28 15:20:34 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:34 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:34 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b640317a-6a9b-4fd6-a0a6-5ba72836e448" returned: 0 in 0.324s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04ceacb-f2c9-47eb-9402-af8701acbe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8beaea-8575-4631-af57-0abe06b329d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-quobyte-b640317a-6a9b-4fd6-a0a6-5ba72836e448" released by "delete_volume" :: held 0.924s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 (6a31710a-bb32-4129-a960-8d9dd9d35cd6): created successfully Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8beaea-8575-4631-af57-0abe06b329d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (ea978100-cfc3-44ab-a996-4cb6bcadd5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b24a0939-b0ae-4d57-be18-4d32403fcba5 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created volume successfully. Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Created reservations ['0bc9acd5-53ea-4812-a998-6252b7854c21', '4b6209a6-7d50-442d-b53f-337fe0d778d9', 'cc101ad0-15da-484e-af99-58e9662957ae', '8d79d7df-f55d-49f8-b5ae-06043f207658'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:35 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:35 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:35 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.354s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Deleted volume successfully. Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-be95c74f-b082-4f86-bba4-76be5b70c95f tempest-CinderUnicodeTest-1129327963 None] Lock "cinder-b640317a-6a9b-4fd6-a0a6-5ba72836e448-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (e781f6fa-bd38-4a84-92aa-bcbc7cf28cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c85a4c-9f24-4e6a-a07a-6d2e3c865b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c85a4c-9f24-4e6a-a07a-6d2e3c865b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566384192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38efe7a3-d2dc-425e-8070-b828428617ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:36Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c09fbd9-7d7d-4199-bbed-b3a5d4f2cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c09fbd9-7d7d-4199-bbed-b3a5d4f2cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde48883-e3ce-49a8-96b2-b2c71ef31a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde48883-e3ce-49a8-96b2-b2c71ef31a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38efe7a3-d2dc-425e-8070-b828428617ef', 'volume_name': 'volume-38efe7a3-d2dc-425e-8070-b828428617ef', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafeea13-240f-425d-ac75-723a04c30543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafeea13-240f-425d-ac75-723a04c30543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1feee1-14ba-4d93-8e1b-c07eb13ae4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:35 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Volume 38efe7a3-d2dc-425e-8070-b828428617ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38efe7a3-d2dc-425e-8070-b828428617ef', 'volume_size': 1} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566384192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38efe7a3-d2dc-425e-8070-b828428617ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:36Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Creating volume 38efe7a3-d2dc-425e-8070-b828428617ef {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:35 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:35 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef 1073741824 Sep 28 15:20:35 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (0147cac5-996f-4d8c-a763-c27ecd0c25ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aec5216-40fe-4137-8574-7674ebcc249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aec5216-40fe-4137-8574-7674ebcc249a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750050624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2419319-9f97-4e80-8ab4-123023d9fc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:36Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679d9850-826b-4b1c-acf9-e03b3afa5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679d9850-826b-4b1c-acf9-e03b3afa5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1fbeeb-4fa5-4f61-b989-c15011f1b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1fbeeb-4fa5-4f61-b989-c15011f1b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2419319-9f97-4e80-8ab4-123023d9fc1e', 'volume_name': 'volume-d2419319-9f97-4e80-8ab4-123023d9fc1e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a9f2d5-de28-4753-8abc-ae88da2b3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a9f2d5-de28-4753-8abc-ae88da2b3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca47d0ee-eeb4-4ff4-984b-a44250f974cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:36 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Volume d2419319-9f97-4e80-8ab4-123023d9fc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2419319-9f97-4e80-8ab4-123023d9fc1e', 'volume_size': 1} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:36 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef 1073741824" returned: 0 in 0.794s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:36 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef Sep 28 15:20:36 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:37 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750050624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2419319-9f97-4e80-8ab4-123023d9fc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:36Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Creating volume d2419319-9f97-4e80-8ab4-123023d9fc1e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:37 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1feee1-14ba-4d93-8e1b-c07eb13ae4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38efe7a3-d2dc-425e-8070-b828428617ef', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e 1073741824 Sep 28 15:20:37 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a3bda3-2687-4ca8-b4fb-9648b637f848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Volume volume-38efe7a3-d2dc-425e-8070-b828428617ef (38efe7a3-d2dc-425e-8070-b828428617ef): created successfully Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a3bda3-2687-4ca8-b4fb-9648b637f848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (e781f6fa-bd38-4a84-92aa-bcbc7cf28cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a474bbb3-acfe-4c6d-9d6f-576eb474b72b tempest-CreateVolumesFromImageTest-260844889 None] Created volume successfully. Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (1b14f5b8-a9b4-45e4-84b7-a21c60e87c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0537a124-6e16-4509-8932-28f9d270db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0537a124-6e16-4509-8932-28f9d270db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151917906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc31576-eff5-4eda-8443-1feb50c1ea84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:37Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03db01c3-d15d-4928-b74a-0a14071a3e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03db01c3-d15d-4928-b74a-0a14071a3e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b03206c-dfb6-42c3-878d-010f81f2eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b03206c-dfb6-42c3-878d-010f81f2eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc31576-eff5-4eda-8443-1feb50c1ea84', 'volume_name': 'volume-3cc31576-eff5-4eda-8443-1feb50c1ea84', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee02a07e-1529-4b68-96ef-9a0856abd662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee02a07e-1529-4b68-96ef-9a0856abd662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa122950-551d-41da-bc75-88a5fb801bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Volume 3cc31576-eff5-4eda-8443-1feb50c1ea84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc31576-eff5-4eda-8443-1feb50c1ea84', 'volume_size': 1} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (dc4e22ac-9dff-48ba-b41f-5374b24172e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c04b5e-4225-4710-ad4d-6ea695f301d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c04b5e-4225-4710-ad4d-6ea695f301d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636715274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f9215e-764d-4fcf-8857-e0da80b9a3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:37Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6716eb74-85e9-4d63-af06-886a5b41bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6716eb74-85e9-4d63-af06-886a5b41bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d2e26a-f4fe-4c52-b4c8-caa54b18a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d2e26a-f4fe-4c52-b4c8-caa54b18a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f9215e-764d-4fcf-8857-e0da80b9a3be', 'volume_name': 'volume-06f9215e-764d-4fcf-8857-e0da80b9a3be', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5a9e63-0f5b-4e78-b114-1b6baab62b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5a9e63-0f5b-4e78-b114-1b6baab62b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4854de3-7da2-4377-a318-0351bf52b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:37 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume 06f9215e-764d-4fcf-8857-e0da80b9a3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f9215e-764d-4fcf-8857-e0da80b9a3be', 'volume_size': 1} Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:37 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e 1073741824" returned: 0 in 0.867s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:38 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e Sep 28 15:20:38 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:38 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e" returned: 0 in 0.369s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151917906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc31576-eff5-4eda-8443-1feb50c1ea84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:37Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Creating volume 3cc31576-eff5-4eda-8443-1feb50c1ea84 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:38 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:38 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 1073741824 Sep 28 15:20:38 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca47d0ee-eeb4-4ff4-984b-a44250f974cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2419319-9f97-4e80-8ab4-123023d9fc1e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13653e13-a886-45f3-81a5-ef52ccd7b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:38 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Volume volume-d2419319-9f97-4e80-8ab4-123023d9fc1e (d2419319-9f97-4e80-8ab4-123023d9fc1e): created successfully Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13653e13-a886-45f3-81a5-ef52ccd7b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (0147cac5-996f-4d8c-a763-c27ecd0c25ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:38 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-453d6593-f360-4939-861e-ff6d283d5328 tempest-CreateVolumesFromImageTest-260844889 None] Created volume successfully. Sep 28 15:20:39 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 1073741824" returned: 0 in 0.654s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:39 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 Sep 28 15:20:39 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (6f66cd74-6ba3-412d-8825-a49176411a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fff12e-2ecc-42ab-8f14-c0b9218ace5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (6f5550f9-e7a7-4620-929b-bf313ea3a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61089d8d-84fc-498e-9bc4-d0931f12998e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fff12e-2ecc-42ab-8f14-c0b9218ace5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1544943792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0caa8d8-7fb8-4e52-9f06-a8ac48a24088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0caa8d8-7fb8-4e52-9f06-a8ac48a24088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79287d66-de62-48d3-b7ea-fa874c089cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79287d66-de62-48d3-b7ea-fa874c089cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac', 'volume_name': 'volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a885424-a180-47b8-abcc-deb14e4fef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a885424-a180-47b8-abcc-deb14e4fef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29861f22-5520-4c84-827a-9f728461dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume 6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac', 'volume_size': 1} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84" returned: 0 in 0.409s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636715274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f9215e-764d-4fcf-8857-e0da80b9a3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:37Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Creating volume 06f9215e-764d-4fcf-8857-e0da80b9a3be {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:39 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:39 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be 1073741824 Sep 28 15:20:39 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61089d8d-84fc-498e-9bc4-d0931f12998e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63416528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a48dd1-10ba-4e43-81b7-984fb725add8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744bb901-917a-4200-91c0-9d45ceffeef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744bb901-917a-4200-91c0-9d45ceffeef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349e6ed3-54f7-4624-8ac0-9f35acd1fa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349e6ed3-54f7-4624-8ac0-9f35acd1fa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a48dd1-10ba-4e43-81b7-984fb725add8', 'volume_name': 'volume-85a48dd1-10ba-4e43-81b7-984fb725add8', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385bf97b-8881-471b-8ad2-4b5cb3f42923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385bf97b-8881-471b-8ad2-4b5cb3f42923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c55ecfc-ab81-421d-b987-b79894b7d5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Volume 85a48dd1-10ba-4e43-81b7-984fb725add8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a48dd1-10ba-4e43-81b7-984fb725add8', 'volume_size': 1} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (fb8aa12f-0db5-4456-b4fb-6e16e5a3eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f86c5f5-9c59-4ccd-aa23-20a077d2c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (32fdd72d-06d0-4b9d-ae5c-8d3095826fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414fc4bf-68a0-423a-a40d-322b9610177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f86c5f5-9c59-4ccd-aa23-20a077d2c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1225505543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a5c74f-3b28-49f1-bda7-40f4034454bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d24c5c-58c2-4c61-8856-7531d38d9d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d24c5c-58c2-4c61-8856-7531d38d9d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b5fdc4-f37a-431b-a176-bc7757d9ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b5fdc4-f37a-431b-a176-bc7757d9ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a5c74f-3b28-49f1-bda7-40f4034454bb', 'volume_name': 'volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313ae1a7-71dc-487f-aee2-14bdf811b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313ae1a7-71dc-487f-aee2-14bdf811b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2bf9fd-6586-40d0-977f-9f7b7a18a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume a2a5c74f-3b28-49f1-bda7-40f4034454bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb', 'volume_size': 1} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414fc4bf-68a0-423a-a40d-322b9610177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1922304859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3126d98d-6b7a-4a25-a142-4a18a168e950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43679e07-d426-4372-917c-b3de28935b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43679e07-d426-4372-917c-b3de28935b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d615e3-04da-4123-9f7e-3b210ba56d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d615e3-04da-4123-9f7e-3b210ba56d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3126d98d-6b7a-4a25-a142-4a18a168e950', 'volume_name': 'volume-3126d98d-6b7a-4a25-a142-4a18a168e950', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c9759d-b30d-4ba7-9ce1-996c1c8323a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c9759d-b30d-4ba7-9ce1-996c1c8323a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136f4a80-7a05-466a-86c3-645f5dadc351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Volume 3126d98d-6b7a-4a25-a142-4a18a168e950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3126d98d-6b7a-4a25-a142-4a18a168e950', 'volume_size': 1} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa122950-551d-41da-bc75-88a5fb801bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc31576-eff5-4eda-8443-1feb50c1ea84', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330b082a-a93e-450d-adfb-422f649a8085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (931b0b86-5af2-4588-a467-bcc97c81186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057ded81-6dff-4802-af1e-68bf238997bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Volume volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 (3cc31576-eff5-4eda-8443-1feb50c1ea84): created successfully Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330b082a-a93e-450d-adfb-422f649a8085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (1b14f5b8-a9b4-45e4-84b7-a21c60e87c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057ded81-6dff-4802-af1e-68bf238997bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112322895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a845b9-a454-4966-a9af-32de791cbb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:40Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f334039-3c6b-4ee1-890d-53c4783d4b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f334039-3c6b-4ee1-890d-53c4783d4b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b18993-0356-4c64-a616-a35878955988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b18993-0356-4c64-a616-a35878955988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a845b9-a454-4966-a9af-32de791cbb19', 'volume_name': 'volume-10a845b9-a454-4966-a9af-32de791cbb19', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38215f32-7ba6-4032-afd7-27ed77c93b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38215f32-7ba6-4032-afd7-27ed77c93b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0c26c1-5afc-4992-a07c-25fad44809f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume 10a845b9-a454-4966-a9af-32de791cbb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a845b9-a454-4966-a9af-32de791cbb19', 'volume_size': 1} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a1f6eba3-6779-4b09-b6bb-076d9db3f79a tempest-CreateVolumesFromImageTest-260844889 None] Created volume successfully. Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (ea7d8757-bd76-415c-9838-3e85a765ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4a5926-89c5-4489-8a87-024519a8d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4a5926-89c5-4489-8a87-024519a8d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204364209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45952d6-7c45-4a29-ad8c-8c6f12cd5b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:40Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f377b45f-bc8d-403d-a758-d2df31ae708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f377b45f-bc8d-403d-a758-d2df31ae708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bf57fc-5213-4ffe-b571-8308afe83cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bf57fc-5213-4ffe-b571-8308afe83cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b45952d6-7c45-4a29-ad8c-8c6f12cd5b67', 'volume_name': 'volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc831bb4-a9c4-486d-8b5b-84d9c5f72b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc831bb4-a9c4-486d-8b5b-84d9c5f72b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5673a4-242c-4890-981b-93f0904e1eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume b45952d6-7c45-4a29-ad8c-8c6f12cd5b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67', 'volume_size': 1} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be 1073741824" returned: 0 in 0.638s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:40 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be Sep 28 15:20:40 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:40 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be" returned: 0 in 0.280s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.114s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1544943792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Creating volume 6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:40 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:40 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4854de3-7da2-4377-a318-0351bf52b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f9215e-764d-4fcf-8857-e0da80b9a3be', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a2b196-ba55-465d-8634-dbfcdcd0eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:40 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac 1073741824 Sep 28 15:20:40 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume volume-06f9215e-764d-4fcf-8857-e0da80b9a3be (06f9215e-764d-4fcf-8857-e0da80b9a3be): created successfully Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a2b196-ba55-465d-8634-dbfcdcd0eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (dc4e22ac-9dff-48ba-b41f-5374b24172e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:40 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cd5066c2-d740-4101-beec-ec8c6542f165 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created volume successfully. Sep 28 15:20:41 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Flow 'volume_create_manager' (b415f1a5-d380-4c3b-8548-9038f4f4aa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699db0ca-acf1-4710-af42-806f736bbfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699db0ca-acf1-4710-af42-806f736bbfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995589570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f062b21e-b9f9-47da-bf01-8b4a6940a48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1156baccd347128d0b1b8cc2bfc842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:41Z,use_quota=True,user_id='d9a0feedcea24f528da4083be6b4f3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25248d30-72ef-4851-960c-9b849d8f9a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25248d30-72ef-4851-960c-9b849d8f9a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114d5f55-0a4b-4d1e-8a98-6a5e857f66f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114d5f55-0a4b-4d1e-8a98-6a5e857f66f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f062b21e-b9f9-47da-bf01-8b4a6940a48a', 'volume_name': 'volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fb8489-4e78-4c73-ba4c-4586407fcac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fb8489-4e78-4c73-ba4c-4586407fcac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7ff88-8969-4d5b-96f1-7291b731fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Volume f062b21e-b9f9-47da-bf01-8b4a6940a48a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a', 'volume_size': 1} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:41 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac 1073741824" returned: 0 in 0.614s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:41 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac Sep 28 15:20:41 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:41 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac" returned: 0 in 0.288s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63416528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a48dd1-10ba-4e43-81b7-984fb725add8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Creating volume 85a48dd1-10ba-4e43-81b7-984fb725add8 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:41 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29861f22-5520-4c84-827a-9f728461dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:41 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 1073741824 Sep 28 15:20:41 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d41800-b999-4aa0-bc6a-392a8a9b1ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac (6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac): created successfully Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d41800-b999-4aa0-bc6a-392a8a9b1ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (6f66cd74-6ba3-412d-8825-a49176411a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ac9c1311-5f65-4d92-8eee-bdd278ee5672 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created volume successfully. Sep 28 15:20:42 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 1073741824" returned: 0 in 0.520s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:42 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 Sep 28 15:20:42 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:42 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8" returned: 0 in 0.258s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.437s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1225505543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a5c74f-3b28-49f1-bda7-40f4034454bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Creating volume a2a5c74f-3b28-49f1-bda7-40f4034454bb {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:42 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c55ecfc-ab81-421d-b987-b79894b7d5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a48dd1-10ba-4e43-81b7-984fb725add8', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870a485e-b8d8-4ca6-9c70-4cf7438931d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:42 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb 1073741824 Sep 28 15:20:42 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:42 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Volume volume-85a48dd1-10ba-4e43-81b7-984fb725add8 (85a48dd1-10ba-4e43-81b7-984fb725add8): created successfully Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870a485e-b8d8-4ca6-9c70-4cf7438931d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (6f5550f9-e7a7-4620-929b-bf313ea3a78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f0b3681c-e7c8-435a-b29c-5a528d9e7853 tempest-CreateVolumesFromImageTest-260844889 None] Created volume successfully. Sep 28 15:20:43 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb 1073741824" returned: 0 in 0.534s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:43 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb Sep 28 15:20:43 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:43 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb" returned: 0 in 0.305s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1922304859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3126d98d-6b7a-4a25-a142-4a18a168e950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624adc840ed042a2b5c3d07d6dcd3cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:39Z,use_quota=True,user_id='1a87df374e0c42f1917a1efa9e46e4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Creating volume 3126d98d-6b7a-4a25-a142-4a18a168e950 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:43 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:43 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 1073741824 Sep 28 15:20:43 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2bf9fd-6586-40d0-977f-9f7b7a18a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848720bc-7d6d-4280-8862-c74c86ee4b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:43 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb (a2a5c74f-3b28-49f1-bda7-40f4034454bb): created successfully Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848720bc-7d6d-4280-8862-c74c86ee4b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (fb8aa12f-0db5-4456-b4fb-6e16e5a3eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-56b45070-3806-4bd7-b170-16a355f760fe tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created volume successfully. Sep 28 15:20:43 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 1073741824" returned: 0 in 0.539s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:43 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 Sep 28 15:20:43 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:44 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950" returned: 0 in 0.291s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.033s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112322895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a845b9-a454-4966-a9af-32de791cbb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:40Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Creating volume 10a845b9-a454-4966-a9af-32de791cbb19 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:44 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136f4a80-7a05-466a-86c3-645f5dadc351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3126d98d-6b7a-4a25-a142-4a18a168e950', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f02af8-9fe1-4611-8011-d81b28dd22b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:44 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 1073741824 Sep 28 15:20:44 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:44 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Volume volume-3126d98d-6b7a-4a25-a142-4a18a168e950 (3126d98d-6b7a-4a25-a142-4a18a168e950): created successfully Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f02af8-9fe1-4611-8011-d81b28dd22b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Flow 'volume_create_manager' (32fdd72d-06d0-4b9d-ae5c-8d3095826fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8fc2d46b-4028-49c4-bb90-c693ff409ce3 tempest-CreateVolumesFromImageTest-260844889 None] Created volume successfully. Sep 28 15:20:44 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 1073741824" returned: 0 in 0.508s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:44 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 Sep 28 15:20:44 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:45 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19" returned: 0 in 0.297s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.786s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204364209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45952d6-7c45-4a29-ad8c-8c6f12cd5b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c15d29e0884175809e4ce2ebbec053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:40Z,use_quota=True,user_id='41da562ba63f4e449c3bd7ca5348dbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Creating volume b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:45 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0c26c1-5afc-4992-a07c-25fad44809f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a845b9-a454-4966-a9af-32de791cbb19', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:45 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 1073741824 Sep 28 15:20:45 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1416b1-0288-4fa2-8e00-32c92b110056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:45 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume volume-10a845b9-a454-4966-a9af-32de791cbb19 (10a845b9-a454-4966-a9af-32de791cbb19): created successfully Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1416b1-0288-4fa2-8e00-32c92b110056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (931b0b86-5af2-4588-a467-bcc97c81186a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4b6e259c-3778-45dc-ae7e-cb65068159d4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created volume successfully. Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-3126d98d-6b7a-4a25-a142-4a18a168e950-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-3126d98d-6b7a-4a25-a142-4a18a168e950-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-quobyte-3126d98d-6b7a-4a25-a142-4a18a168e950" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-3126d98d-6b7a-4a25-a142-4a18a168e950" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce8523-4fa6-4d28-8520-3da3e3c2ab0a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:45 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 Sep 28 15:20:45 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:45 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 1073741824" returned: 0 in 0.586s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:45 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 Sep 28 15:20:45 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:45 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:45 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950 Sep 28 15:20:45 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:46 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67" returned: 0 in 0.282s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.777s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995589570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f062b21e-b9f9-47da-bf01-8b4a6940a48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1156baccd347128d0b1b8cc2bfc842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:41Z,use_quota=True,user_id='d9a0feedcea24f528da4083be6b4f3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Creating volume f062b21e-b9f9-47da-bf01-8b4a6940a48a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:46 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5673a4-242c-4890-981b-93f0904e1eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:46 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a 1073741824 Sep 28 15:20:46 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8687358-6969-400b-94c8-185a038301a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Volume volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 (b45952d6-7c45-4a29-ad8c-8c6f12cd5b67): created successfully Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8687358-6969-400b-94c8-185a038301a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Flow 'volume_create_manager' (ea7d8757-bd76-415c-9838-3e85a765ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-beabe736-35d2-479a-a018-541d22d376a8 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created volume successfully. Sep 28 15:20:46 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3126d98d-6b7a-4a25-a142-4a18a168e950" returned: 0 in 0.283s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-3126d98d-6b7a-4a25-a142-4a18a168e950" released by "delete_volume" :: held 0.733s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Created reservations ['a382ada8-c4de-4afe-9a32-94480ad05651', '4b0f73ec-9a2d-435a-b44d-9e919db9ad56', 'acae90d3-bf1f-4d00-a41a-4fb0d2400179', '68f8e11a-3c59-462f-b346-d9cb8afb68df'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:46 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:46 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-85a48dd1-10ba-4e43-81b7-984fb725add8-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:46 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a 1073741824" returned: 0 in 0.611s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-85a48dd1-10ba-4e43-81b7-984fb725add8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:46 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Deleted volume successfully. Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-quobyte-85a48dd1-10ba-4e43-81b7-984fb725add8" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d26f062b-4aae-4082-9460-6f9067d6fc76 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-3126d98d-6b7a-4a25-a142-4a18a168e950-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:46 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a Sep 28 15:20:46 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-85a48dd1-10ba-4e43-81b7-984fb725add8" acquired by "delete_volume" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4ee56-38cc-4f5b-bcec-cd01785802c0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:47 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 Sep 28 15:20:47 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:47 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a" returned: 0 in 0.309s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7ff88-8969-4d5b-96f1-7291b731fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb42598e-1194-4956-b8fe-5e92f3522746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-10a845b9-a454-4966-a9af-32de791cbb19-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Volume volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a (f062b21e-b9f9-47da-bf01-8b4a6940a48a): created successfully Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb42598e-1194-4956-b8fe-5e92f3522746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Flow 'volume_create_manager' (b415f1a5-d380-4c3b-8548-9038f4f4aa4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-10a845b9-a454-4966-a9af-32de791cbb19-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4cf81bf8-c4ea-41c3-ad98-8d638aaf0a8b tempest-ProjectReaderTests-323343418 None] Created volume successfully. Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-quobyte-10a845b9-a454-4966-a9af-32de791cbb19" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-10a845b9-a454-4966-a9af-32de791cbb19" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e46eb-b890-48f6-b55e-36557350b90c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:47 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8" returned: 0 in 0.522s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:47 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8 Sep 28 15:20:47 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:47 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 Sep 28 15:20:47 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:47 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-85a48dd1-10ba-4e43-81b7-984fb725add8" returned: 0 in 0.335s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-85a48dd1-10ba-4e43-81b7-984fb725add8" released by "delete_volume" :: held 0.919s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Created reservations ['17f6e529-d26b-4e77-9b0c-dd7e831f8142', 'cfbf32ad-a05c-47c6-b5db-c68964d2699a', '36cc8340-d89c-4f63-83a6-4192837ffa5a', 'bd7e2997-6a59-4235-a14e-f822e1a02e05'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:47 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19" returned: 0 in 0.552s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Acquiring lock "cinder-f062b21e-b9f9-47da-bf01-8b4a6940a48a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:47 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19 Sep 28 15:20:47 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Lock "cinder-f062b21e-b9f9-47da-bf01-8b4a6940a48a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Acquiring lock "cinder-quobyte-f062b21e-b9f9-47da-bf01-8b4a6940a48a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Lock "cinder-quobyte-f062b21e-b9f9-47da-bf01-8b4a6940a48a" acquired by "delete_volume" :: waited 0.050s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:48 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:48 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[480a12fe-e8dd-414c-94a4-4436d019d3e5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-10a845b9-a454-4966-a9af-32de791cbb19" returned: 0 in 0.318s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-10a845b9-a454-4966-a9af-32de791cbb19" released by "delete_volume" :: held 0.933s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:48 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a Sep 28 15:20:48 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created reservations ['e9a220c6-8f9c-4b4f-be6a-b12a94318975', 'ddc42085-a42f-4d85-98e7-9c0512b487d2', '8f1ecb13-44d2-44bb-93e2-a33cdd78173e', '33a402ab-e75b-48db-b43f-074e96f7f9fd'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:48 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.350s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Deleted volume successfully. Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3a7fc550-5593-4f7b-8f24-fb73348a7840 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-85a48dd1-10ba-4e43-81b7-984fb725add8-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:48 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:48 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a" returned: 0 in 0.505s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:48 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a Sep 28 15:20:48 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:48 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.307s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Deleted volume successfully. Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-befd0f92-e237-41d7-96d8-c52fc2f1bc4b tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-10a845b9-a454-4966-a9af-32de791cbb19-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:48 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f062b21e-b9f9-47da-bf01-8b4a6940a48a" returned: 0 in 0.346s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Lock "cinder-quobyte-f062b21e-b9f9-47da-bf01-8b4a6940a48a" released by "delete_volume" :: held 0.924s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Created reservations ['da24c517-6cef-4b56-b54d-ae0c38c6ed80', 'c975c49a-e320-414a-a088-300261651b60', 'bceab0d2-0101-4172-9080-54a80761f947', 'aee610d8-ed13-4888-af6f-9fd891371141'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-3cc31576-eff5-4eda-8443-1feb50c1ea84-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-3cc31576-eff5-4eda-8443-1feb50c1ea84-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-quobyte-3cc31576-eff5-4eda-8443-1feb50c1ea84" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-3cc31576-eff5-4eda-8443-1feb50c1ea84" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a223a42-cf31-4f27-bfd9-d67c0da74814]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:49 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 Sep 28 15:20:49 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:49 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.324s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Deleted volume successfully. Sep 28 15:20:49 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84" returned: 0 in 0.434s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84 Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b5bd011-81cf-4d2c-8abd-1b938fcaf12a tempest-ProjectReaderTests-323343418 None] Lock "cinder-f062b21e-b9f9-47da-bf01-8b4a6940a48a-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:49 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-quobyte-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c0636-dd3e-4cbb-857f-6b714a254ce9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:49 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc31576-eff5-4eda-8443-1feb50c1ea84" returned: 0 in 0.302s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-3cc31576-eff5-4eda-8443-1feb50c1ea84" released by "delete_volume" :: held 0.801s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:50 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 Sep 28 15:20:50 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:50 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67" returned: 0 in 0.425s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:50 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67 Sep 28 15:20:50 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:50 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67" returned: 0 in 0.285s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67" released by "delete_volume" :: held 0.762s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:50 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Created reservations ['475c64ac-7a28-49a8-a72f-6c678a02dbe2', '31ba7fde-6a6d-4ac0-b929-fa95cc11638e', '53c11a49-6d68-4f1c-acbb-097b01ce3879', 'cee21243-39eb-4097-abc0-e1669819b8fd'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:51 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created reservations ['1fc15d15-5480-4e99-8b5b-124ef4f6d4f6', '735804c0-9394-4ec7-8f50-49a9230b913f', '59583224-5988-4b85-af3a-c2099373b247', '9ab3b3b1-9f28-4182-bef0-015119a56c4b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:52 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:52 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:53 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.257s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:53 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Deleted volume successfully. Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-d2419319-9f97-4e80-8ab4-123023d9fc1e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-1d26343e-96ab-4798-92db-85d77cd94752 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-3cc31576-eff5-4eda-8443-1feb50c1ea84-delete_volume" released by "delete_volume" :: held 5.171s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:54 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:54 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-d2419319-9f97-4e80-8ab4-123023d9fc1e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:54 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.266s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:54 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Deleted volume successfully. Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e4c7d7e7-7780-4fe1-9d85-eedf5d532ef4 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-b45952d6-7c45-4a29-ad8c-8c6f12cd5b67-delete_volume" released by "delete_volume" :: held 5.603s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-quobyte-d2419319-9f97-4e80-8ab4-123023d9fc1e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-d2419319-9f97-4e80-8ab4-123023d9fc1e" acquired by "delete_volume" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[381c6fa9-ded3-4330-bb9e-dfec90d74aab]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-a2a5c74f-3b28-49f1-bda7-40f4034454bb-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-a2a5c74f-3b28-49f1-bda7-40f4034454bb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:55 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e Sep 28 15:20:55 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-quobyte-a2a5c74f-3b28-49f1-bda7-40f4034454bb" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Flow 'volume_create_manager' (57da950c-ef0b-41cd-8ae1-badec5992a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b55d6d-53d0-464b-9789-4adbe37a2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-a2a5c74f-3b28-49f1-bda7-40f4034454bb" acquired by "delete_volume" :: waited 0.068s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b55d6d-53d0-464b-9789-4adbe37a2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77889621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cceedd-2552-48a2-825a-1a425ab735fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1156baccd347128d0b1b8cc2bfc842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:55Z,use_quota=True,user_id='d9a0feedcea24f528da4083be6b4f3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b07db8c-243d-48c7-acff-0d7c985f3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b07db8c-243d-48c7-acff-0d7c985f3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4e153a-d2d8-4f8e-a938-e01a9ffb40ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4e153a-d2d8-4f8e-a938-e01a9ffb40ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1cceedd-2552-48a2-825a-1a425ab735fd', 'volume_name': 'volume-f1cceedd-2552-48a2-825a-1a425ab735fd', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f021754-a08c-478c-92ac-90083d04ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f021754-a08c-478c-92ac-90083d04ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5155237e-c4b7-4f2f-9ea6-ed18d3470fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:55 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Volume f1cceedd-2552-48a2-825a-1a425ab735fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1cceedd-2552-48a2-825a-1a425ab735fd', 'volume_size': 1} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77889621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cceedd-2552-48a2-825a-1a425ab735fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1156baccd347128d0b1b8cc2bfc842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:55Z,use_quota=True,user_id='d9a0feedcea24f528da4083be6b4f3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Creating volume f1cceedd-2552-48a2-825a-1a425ab735fd {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:55 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:20:55 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[03856c9e-cb3c-4ffc-b65e-130cb24b4105]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e" returned: 0 in 0.493s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:55 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd 1073741824 Sep 28 15:20:55 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:55 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e Sep 28 15:20:55 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:55 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb Sep 28 15:20:55 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:56 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d2419319-9f97-4e80-8ab4-123023d9fc1e" returned: 0 in 0.384s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-d2419319-9f97-4e80-8ab4-123023d9fc1e" released by "delete_volume" :: held 0.937s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:56 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb" returned: 0 in 0.441s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb Sep 28 15:20:56 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Created reservations ['bbe93dfa-a5b8-4ead-95c4-13b314d63805', '8672a7a4-3c3c-4856-a0c7-26ede1da3cfb', '9006b972-98b4-40cd-9e12-47cb2930d861', '0360a6c2-fa4f-4a8a-8a74-77bd53060295'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:56 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd 1073741824" returned: 0 in 0.544s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd Sep 28 15:20:56 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:56 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:56 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a2a5c74f-3b28-49f1-bda7-40f4034454bb" returned: 0 in 0.294s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-a2a5c74f-3b28-49f1-bda7-40f4034454bb" released by "delete_volume" :: held 0.874s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created reservations ['fc5edc19-5eef-4a66-ad3b-fd8f1e421ca3', '5b234000-8ef5-46e5-8fd8-751b3c1ff2e8', '6d3e91c9-91ab-4a5e-b18c-17d111385fa7', '476bb8dc-0f4c-4a45-984f-5e9d26525870'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-38efe7a3-d2dc-425e-8070-b828428617ef-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-38efe7a3-d2dc-425e-8070-b828428617ef-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:56 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd" returned: 0 in 0.402s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:56 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.357s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5155237e-c4b7-4f2f-9ea6-ed18d3470fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cceedd-2552-48a2-825a-1a425ab735fd', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d22a34-9295-4ba7-819a-08604c1c20c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "cinder-quobyte-38efe7a3-d2dc-425e-8070-b828428617ef" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Deleted volume successfully. Sep 28 15:20:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Volume volume-f1cceedd-2552-48a2-825a-1a425ab735fd (f1cceedd-2552-48a2-825a-1a425ab735fd): created successfully Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d22a34-9295-4ba7-819a-08604c1c20c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:56 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Flow 'volume_create_manager' (57da950c-ef0b-41cd-8ae1-badec5992a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:56 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-38efe7a3-d2dc-425e-8070-b828428617ef" acquired by "delete_volume" :: waited 0.065s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e3b49d34-97c7-4e31-bc21-19811e7a2ec9 tempest-ProjectReaderTests-323343418 None] Created volume successfully. Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5283f7ed-cf89-4921-9bc6-b8f820ece6a0 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-d2419319-9f97-4e80-8ab4-123023d9fc1e-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b44a5c-e2f5-41bc-87bd-15db123a7859]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:56 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef Sep 28 15:20:56 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:57 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.324s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Deleted volume successfully. Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-236d6b6c-aadc-4694-94ab-e2988576f0aa tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-a2a5c74f-3b28-49f1-bda7-40f4034454bb-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:57 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef" returned: 0 in 0.459s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:57 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef Sep 28 15:20:57 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Acquiring lock "cinder-f1cceedd-2552-48a2-825a-1a425ab735fd-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Lock "cinder-f1cceedd-2552-48a2-825a-1a425ab735fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Acquiring lock "cinder-quobyte-f1cceedd-2552-48a2-825a-1a425ab735fd" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Lock "cinder-quobyte-f1cceedd-2552-48a2-825a-1a425ab735fd" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:57 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38efe7a3-d2dc-425e-8070-b828428617ef" returned: 0 in 0.370s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-quobyte-38efe7a3-d2dc-425e-8070-b828428617ef" released by "delete_volume" :: held 0.916s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a5f83-6fe0-464b-82a8-0cc8741d5b96]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-quobyte-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Created reservations ['294cde6d-f3db-49a8-98b5-5d5792b10b65', 'cfe99fb2-cdd6-4be8-a14d-94dadcd73c71', '11ff1274-ccaf-4bdb-8dd9-1705f1fc5246', 'e8c859f5-a234-43a7-a708-ad206d796b3e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:57 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd Sep 28 15:20:57 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93349cd-2d9c-461c-8eff-37503b5780a6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:58 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:58 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:58 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac Sep 28 15:20:58 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:58 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd" returned: 0 in 0.541s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:58 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:58 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.294s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:58 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Deleted volume successfully. Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a1af1a53-e439-473b-adc8-92b1f84b4763 tempest-CreateVolumesFromImageTest-260844889 None] Lock "cinder-38efe7a3-d2dc-425e-8070-b828428617ef-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:58 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac" returned: 0 in 0.498s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:58 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac Sep 28 15:20:58 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:58 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f1cceedd-2552-48a2-825a-1a425ab735fd" returned: 0 in 0.325s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Lock "cinder-quobyte-f1cceedd-2552-48a2-825a-1a425ab735fd" released by "delete_volume" :: held 0.972s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Created reservations ['378106a2-5055-4861-89ff-522ebae7630f', 'b3c8ce9b-d9ef-49e7-aed6-72a8f28b48d8', 'd0d0f619-6be9-4fe6-a67b-751d02a4bd00', 'dfc81556-ae4c-4259-9ab4-e53b1f86508b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:58 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac" returned: 0 in 0.299s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac" released by "delete_volume" :: held 0.863s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:58 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:58 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created reservations ['9bf2a54a-5cc2-4edc-82a6-f0238d3b8fb5', 'cd0cdddb-4c49-4aa5-8e21-c2916f2efa04', '1a9df8c8-fb9b-499c-8c5a-60f8191df7ac', '508683fd-ff7b-418f-a0e2-ab8b69f21b6b'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:59 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:20:59 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:59 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.380s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Deleted volume successfully. Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bc3a771a-2f83-4270-8fa7-1e43c068fb1c tempest-ProjectReaderTests-323343418 None] Lock "cinder-f1cceedd-2552-48a2-825a-1a425ab735fd-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:59 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.323s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Deleted volume successfully. Sep 28 15:20:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4b1b393b-65a7-44e3-bddb-e38826148397 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-6a7a9cd8-55ab-4ec5-9771-7e1e1501e9ac-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-06f9215e-764d-4fcf-8857-e0da80b9a3be-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-06f9215e-764d-4fcf-8857-e0da80b9a3be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-quobyte-06f9215e-764d-4fcf-8857-e0da80b9a3be" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-06f9215e-764d-4fcf-8857-e0da80b9a3be" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f69ff-1d0f-4218-91a7-e3d2b80f4ead]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:00 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be Sep 28 15:21:00 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:00 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be" returned: 0 in 0.512s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:00 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be Sep 28 15:21:00 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:01 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-06f9215e-764d-4fcf-8857-e0da80b9a3be" returned: 0 in 0.364s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-06f9215e-764d-4fcf-8857-e0da80b9a3be" released by "delete_volume" :: held 0.936s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created reservations ['e4277129-3507-4aff-bb8b-06659ea7b5dd', 'de08fd0c-d26f-4d64-8adf-2033f71ffa09', 'd07ce4fa-3be3-4d93-8e97-355f3790742d', '315a052a-08a6-487b-b4d6-6514898c5d00'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:01 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:01 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:01 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.326s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Deleted volume successfully. Sep 28 15:21:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33e37f3-5eb9-4794-acd5-84ebd83c14f1 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-06f9215e-764d-4fcf-8857-e0da80b9a3be-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-6a31710a-bb32-4129-a960-8d9dd9d35cd6-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-6a31710a-bb32-4129-a960-8d9dd9d35cd6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "cinder-quobyte-6a31710a-bb32-4129-a960-8d9dd9d35cd6" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-6a31710a-bb32-4129-a960-8d9dd9d35cd6" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb492c7b-fd14-49cb-83bc-9320f25742ba]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:02 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 Sep 28 15:21:02 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (d070cacb-e3ff-4080-9d1e-25bd6c8f19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f652c206-ab9d-4121-bcff-08882709a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f652c206-ab9d-4121-bcff-08882709a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594722703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665184a0-03a2-458a-8b82-4cc96cdffc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:03Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7837ea6a-4494-43dc-828f-e34a98fa390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7837ea6a-4494-43dc-828f-e34a98fa390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c549bcd-6e4a-4061-957b-ca1bf388470f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c549bcd-6e4a-4061-957b-ca1bf388470f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665184a0-03a2-458a-8b82-4cc96cdffc38', 'volume_name': 'volume-665184a0-03a2-458a-8b82-4cc96cdffc38', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fffad05-012c-45ed-9f15-99008b741e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:02 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fffad05-012c-45ed-9f15-99008b741e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fa945e-07e5-4cb2-b412-d9366e929222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:03 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume 665184a0-03a2-458a-8b82-4cc96cdffc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665184a0-03a2-458a-8b82-4cc96cdffc38', 'volume_size': 1} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594722703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665184a0-03a2-458a-8b82-4cc96cdffc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:03Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating volume 665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:03 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:03 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 1073741824 Sep 28 15:21:03 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:03 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6" returned: 0 in 0.493s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:03 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6 Sep 28 15:21:03 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:03 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6a31710a-bb32-4129-a960-8d9dd9d35cd6" returned: 0 in 0.293s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-quobyte-6a31710a-bb32-4129-a960-8d9dd9d35cd6" released by "delete_volume" :: held 0.865s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Created reservations ['3eac6d9b-5e4c-49e6-b495-98d6cca60374', '8abc36d8-8657-40a9-8547-58019b9552fd', '27a67db1-a86b-49a9-8e64-618f41080aa1', '5d69d63a-1124-4e5a-8ce5-4877a31a3b4f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:03 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 1073741824" returned: 0 in 0.498s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:03 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 Sep 28 15:21:03 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:03 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:03 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:03 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38" returned: 0 in 0.413s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fa945e-07e5-4cb2-b412-d9366e929222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665184a0-03a2-458a-8b82-4cc96cdffc38', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0872d3d2-aa84-44da-8b1f-92c61753bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:04 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume volume-665184a0-03a2-458a-8b82-4cc96cdffc38 (665184a0-03a2-458a-8b82-4cc96cdffc38): created successfully Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0872d3d2-aa84-44da-8b1f-92c61753bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (d070cacb-e3ff-4080-9d1e-25bd6c8f19ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-29609891-14fe-4d5b-964b-f447463cc61b tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created volume successfully. Sep 28 15:21:04 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.524s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:04 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Deleted volume successfully. Sep 28 15:21:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d162ab23-d150-431b-917b-70bad74995c0 tempest-CreateVolumesFromSourceVolumeTest-2099319905 None] Lock "cinder-6a31710a-bb32-4129-a960-8d9dd9d35cd6-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating offline snapshot 9b5b447b-6619-46fc-a390-9705f5249aec of volume 665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[631c3492-16a9-4509-9fb1-6adf9d887435]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:05 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 Sep 28 15:21:05 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:05 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38" returned: 0 in 0.467s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:05 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec 1G Sep 28 15:21:05 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec 1G" returned: 0 in 0.492s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665184a0-03a2-458a-8b82-4cc96cdffc38 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665184a0-03a2-458a-8b82-4cc96cdffc38 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec Sep 28 15:21:06 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665184a0-03a2-458a-8b82-4cc96cdffc38 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec" returned: 0 in 0.331s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:06 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec is being set with open permissions: ugo+rw Sep 28 15:21:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:06 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec Sep 28 15:21:06 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:06 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec" returned: 0 in 0.340s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:07 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info Sep 28 15:21:07 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:07 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info" returned: 0 in 0.366s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:07 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info is being set with open permissions: ugo+rw Sep 28 15:21:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:07 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info Sep 28 15:21:07 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:07 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.info" returned: 0 in 0.285s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-02e707b1-c10d-4d20-b63d-c15c0c3e48d4 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Create snapshot completed successfully Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (c75207aa-ae47-4fb6-b022-24e15a2e2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f809099d-e7a9-4604-9d0d-f2102ff5e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f809099d-e7a9-4604-9d0d-f2102ff5e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080611361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6519c19-9272-44e4-b0cf-8dad294b44bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:09Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641e7ee5-7459-4426-b74e-067c218da0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641e7ee5-7459-4426-b74e-067c218da0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcafad5d-4aac-40f0-a072-88d0da7a8a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcafad5d-4aac-40f0-a072-88d0da7a8a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6519c19-9272-44e4-b0cf-8dad294b44bf', 'volume_name': 'volume-e6519c19-9272-44e4-b0cf-8dad294b44bf', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8062e811-a05d-4d5a-bbbd-b6bab36a72e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8062e811-a05d-4d5a-bbbd-b6bab36a72e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c230806-6772-4cb6-9b97-7ca3c44c86bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume e6519c19-9272-44e4-b0cf-8dad294b44bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6519c19-9272-44e4-b0cf-8dad294b44bf', 'volume_size': 1} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080611361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6519c19-9272-44e4-b0cf-8dad294b44bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:09Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating volume e6519c19-9272-44e4-b0cf-8dad294b44bf {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:09 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:09 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf 1073741824 Sep 28 15:21:09 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (71703548-0660-409c-9b1e-b8dd1b6625b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0444f70a-42f8-47e8-a386-ebe0d7a50728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0444f70a-42f8-47e8-a386-ebe0d7a50728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1386462812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:09Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31ad3cb-affb-495f-bf4d-9fc85e66304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31ad3cb-affb-495f-bf4d-9fc85e66304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617ca689-1049-49a0-acc0-338555b1b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617ca689-1049-49a0-acc0-338555b1b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f', 'volume_name': 'volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d86f8b6-2ce2-4d24-985a-c20411f4b9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d86f8b6-2ce2-4d24-985a-c20411f4b9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc55ca9f-abc6-4991-8005-46f0049101d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume 1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f', 'volume_size': 1} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:09 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf 1073741824" returned: 0 in 0.628s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:09 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf Sep 28 15:21:09 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (b99588f7-9d52-4827-820d-b507bd49b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bbe7e1-2193-40ea-9b5b-dec2bb95b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bbe7e1-2193-40ea-9b5b-dec2bb95b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-69848353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7900a868-6930-4782-a0ef-479e1ebc67d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:10Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34807ded-0856-4c77-9cfb-55812d81072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34807ded-0856-4c77-9cfb-55812d81072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba675b-ffcb-475a-ac58-1a814faa5280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba675b-ffcb-475a-ac58-1a814faa5280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7900a868-6930-4782-a0ef-479e1ebc67d0', 'volume_name': 'volume-7900a868-6930-4782-a0ef-479e1ebc67d0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a294952a-19d1-476e-af25-21b4502bbbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a294952a-19d1-476e-af25-21b4502bbbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846fffb0-3e3c-4fed-8fff-a37e5656d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume 7900a868-6930-4782-a0ef-479e1ebc67d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7900a868-6930-4782-a0ef-479e1ebc67d0', 'volume_size': 1} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:10 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf" returned: 0 in 0.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1386462812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:09Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating volume 1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:10 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c230806-6772-4cb6-9b97-7ca3c44c86bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6519c19-9272-44e4-b0cf-8dad294b44bf', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ab847a-0052-4414-a2d0-b568aa072284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f 1073741824 Sep 28 15:21:10 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume volume-e6519c19-9272-44e4-b0cf-8dad294b44bf (e6519c19-9272-44e4-b0cf-8dad294b44bf): created successfully Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ab847a-0052-4414-a2d0-b568aa072284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (c75207aa-ae47-4fb6-b022-24e15a2e2d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:10 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-82f65855-eb98-4ecf-99ea-f528ae61be12 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created volume successfully. Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (75b328a7-a62e-4df0-85b8-7cddb717d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42318118-e3ae-4889-bf45-d46f7c153e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42318118-e3ae-4889-bf45-d46f7c153e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165531947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0eb0fe-4679-4bfb-9223-251604fc04fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:10Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0d422e-e5a1-4084-9ecf-6d063f0f4a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0d422e-e5a1-4084-9ecf-6d063f0f4a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9498d7-2846-48de-82ff-cd8b69971ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9498d7-2846-48de-82ff-cd8b69971ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0eb0fe-4679-4bfb-9223-251604fc04fb', 'volume_name': 'volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723ea08e-9b17-4bb8-a793-94de4c06d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723ea08e-9b17-4bb8-a793-94de4c06d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1ac2a4-a93b-4172-bccd-45e589be9eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume fc0eb0fe-4679-4bfb-9223-251604fc04fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb', 'volume_size': 1} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (8ea34f66-3136-42c2-b470-284dcb797349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422b91f6-af16-4950-b00e-3e0e696103d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f 1073741824" returned: 0 in 0.593s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422b91f6-af16-4950-b00e-3e0e696103d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1884745647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca88a16-5a9f-4540-8d31-29b37fd6efb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:11Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf938a-e9b5-49ea-ab30-1b594d39b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf938a-e9b5-49ea-ab30-1b594d39b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab95bb9-8a7d-4e41-83a6-f7d08270e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab95bb9-8a7d-4e41-83a6-f7d08270e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca88a16-5a9f-4540-8d31-29b37fd6efb0', 'volume_name': 'volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c2957-cf3e-4941-b7e5-4badbb9747bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c2957-cf3e-4941-b7e5-4badbb9747bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb873a54-d420-40e2-a856-89a24517d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:10 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume bca88a16-5a9f-4540-8d31-29b37fd6efb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0', 'volume_size': 1} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:10 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f Sep 28 15:21:10 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:11 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f" returned: 0 in 0.267s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-69848353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7900a868-6930-4782-a0ef-479e1ebc67d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:10Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating volume 7900a868-6930-4782-a0ef-479e1ebc67d0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:11 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc55ca9f-abc6-4991-8005-46f0049101d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:11 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 1073741824 Sep 28 15:21:11 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07c3a00-7172-4382-a14b-390a98f4e109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f (1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f): created successfully Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07c3a00-7172-4382-a14b-390a98f4e109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (71703548-0660-409c-9b1e-b8dd1b6625b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0b3f3dd9-63f5-43c0-a568-72acce271b36 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created volume successfully. Sep 28 15:21:11 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 1073741824" returned: 0 in 0.516s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=198,cinder:SELECT=145,cinder:INSERT=55,cinder:DELETE=17 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:11 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 Sep 28 15:21:11 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:12 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0" returned: 0 in 0.269s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165531947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0eb0fe-4679-4bfb-9223-251604fc04fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:10Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating volume fc0eb0fe-4679-4bfb-9223-251604fc04fb {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:12 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846fffb0-3e3c-4fed-8fff-a37e5656d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7900a868-6930-4782-a0ef-479e1ebc67d0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:12 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb 1073741824 Sep 28 15:21:12 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc84d1-3216-45a3-ab51-a65f71248ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:12 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume volume-7900a868-6930-4782-a0ef-479e1ebc67d0 (7900a868-6930-4782-a0ef-479e1ebc67d0): created successfully Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc84d1-3216-45a3-ab51-a65f71248ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (b99588f7-9d52-4827-820d-b507bd49b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-00446cf3-0f8e-405f-a4d3-30cb7c70a817 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created volume successfully. Sep 28 15:21:12 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb 1073741824" returned: 0 in 0.454s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:12 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb Sep 28 15:21:12 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:12 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb" returned: 0 in 0.260s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1884745647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca88a16-5a9f-4540-8d31-29b37fd6efb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82adb365ce514da1ba5107f6108cd914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:11Z,use_quota=True,user_id='31d60677631044e6b4463e33be19b68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Creating volume bca88a16-5a9f-4540-8d31-29b37fd6efb0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:12 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1ac2a4-a93b-4172-bccd-45e589be9eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:12 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 1073741824 Sep 28 15:21:12 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263ecd44-f181-4402-b570-69ca99bccaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:12 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb (fc0eb0fe-4679-4bfb-9223-251604fc04fb): created successfully Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263ecd44-f181-4402-b570-69ca99bccaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:12 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (75b328a7-a62e-4df0-85b8-7cddb717d90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:12 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f8b4f961-b79e-4997-a2f4-4378ef9cd647 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created volume successfully. Sep 28 15:21:13 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 1073741824" returned: 0 in 0.461s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:13 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 Sep 28 15:21:13 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:13 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0" returned: 0 in 0.244s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb873a54-d420-40e2-a856-89a24517d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0099ecf-f302-4af0-a4e2-bca7bce36f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:13 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Volume volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 (bca88a16-5a9f-4540-8d31-29b37fd6efb0): created successfully Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0099ecf-f302-4af0-a4e2-bca7bce36f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Flow 'volume_create_manager' (8ea34f66-3136-42c2-b470-284dcb797349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6de25734-3603-4dd0-8f40-b7ff5ece998a tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created volume successfully. Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-bca88a16-5a9f-4540-8d31-29b37fd6efb0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-bca88a16-5a9f-4540-8d31-29b37fd6efb0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-bca88a16-5a9f-4540-8d31-29b37fd6efb0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-bca88a16-5a9f-4540-8d31-29b37fd6efb0" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf04d7-31fe-4d91-9d51-107542d99c09]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:14 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 Sep 28 15:21:14 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:14 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0" returned: 0 in 0.375s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:14 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0 Sep 28 15:21:14 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:14 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bca88a16-5a9f-4540-8d31-29b37fd6efb0" returned: 0 in 0.268s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-bca88a16-5a9f-4540-8d31-29b37fd6efb0" released by "delete_volume" :: held 0.693s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['cedbfa6f-f5eb-4e6b-811b-bc7b5bd3eab5', '6fa2b3f7-a590-449e-97ac-770f666115da', '31d28ea2-acec-4866-977a-2f90e6ac993e', '86a007e3-b29c-4bde-8330-1ffbc772b858'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:15 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:15 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-fc0eb0fe-4679-4bfb-9223-251604fc04fb-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:15 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.270s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:15 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleted volume successfully. Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-fc0eb0fe-4679-4bfb-9223-251604fc04fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ece49f8b-63be-44f3-8ea3-28d606c8e746 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-bca88a16-5a9f-4540-8d31-29b37fd6efb0-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-fc0eb0fe-4679-4bfb-9223-251604fc04fb" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-fc0eb0fe-4679-4bfb-9223-251604fc04fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[65564fa7-04af-47f1-bac3-cf5a06447338]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:15 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb Sep 28 15:21:15 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:15 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb" returned: 0 in 0.391s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:16 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb Sep 28 15:21:16 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:16 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fc0eb0fe-4679-4bfb-9223-251604fc04fb" returned: 0 in 0.243s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-fc0eb0fe-4679-4bfb-9223-251604fc04fb" released by "delete_volume" :: held 0.680s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['db488268-90f8-4144-b76a-6324ce1269fb', '7c3e7079-579a-434a-aeb2-ce9b7acea838', 'b58f2d1f-43a3-492a-ae52-19b9f78ce442', 'db0dc6c1-1855-48ad-9633-3b51de54be76'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:16 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:16 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:16 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.245s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:16 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleted volume successfully. Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-742ac3a7-9e44-45f8-ae74-d2cb18d63f85 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-fc0eb0fe-4679-4bfb-9223-251604fc04fb-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-7900a868-6930-4782-a0ef-479e1ebc67d0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-7900a868-6930-4782-a0ef-479e1ebc67d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-7900a868-6930-4782-a0ef-479e1ebc67d0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-7900a868-6930-4782-a0ef-479e1ebc67d0" acquired by "delete_volume" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4197666-267c-41cc-9e75-99d853095fec]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:16 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 Sep 28 15:21:16 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:17 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0" returned: 0 in 0.376s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:17 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0 Sep 28 15:21:17 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:17 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7900a868-6930-4782-a0ef-479e1ebc67d0" returned: 0 in 0.251s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-7900a868-6930-4782-a0ef-479e1ebc67d0" released by "delete_volume" :: held 0.673s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['3c83a30b-145f-47fa-a046-1a36e2e831de', '93dfec75-ccb0-4510-a6f1-b057ead8bdf5', 'ea7c79b7-226f-47a9-9b13-2b212e32279b', 'dbbdea34-5a74-4b80-85c1-70089fd8a470'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:17 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:17 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:17 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.245s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleted volume successfully. Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-4dd30972-ccdd-49d7-a59b-002e3c8beba1 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-7900a868-6930-4782-a0ef-479e1ebc67d0-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b717c7e7-53f3-4acd-9017-cf91235f3aae]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:18 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f Sep 28 15:21:18 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:18 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f" returned: 0 in 0.360s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:18 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f Sep 28 15:21:18 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:18 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f" returned: 0 in 0.240s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f" released by "delete_volume" :: held 0.640s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['4394306f-4d92-4d86-b44c-ad461c67ad9d', 'c2127a8a-1d2e-44e1-a3b1-99e55bbc11a7', '35c46e00-78ab-4372-8065-4202365f6372', '86c21006-971f-4bd8-977e-3e83760f130e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:18 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:18 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:18 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.262s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:18 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleted volume successfully. Sep 28 15:21:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2db926ac-33fc-433e-9353-ded4e6d5dfe0 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-1e5496f9-cc8e-45d8-b22e-9fe45c6efa6f-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-e6519c19-9272-44e4-b0cf-8dad294b44bf-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-e6519c19-9272-44e4-b0cf-8dad294b44bf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-e6519c19-9272-44e4-b0cf-8dad294b44bf" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-e6519c19-9272-44e4-b0cf-8dad294b44bf" acquired by "delete_volume" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06167e-77a9-42c1-a307-db302aeeaa2a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf Sep 28 15:21:19 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:19 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf" returned: 0 in 0.378s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf Sep 28 15:21:19 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:19 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e6519c19-9272-44e4-b0cf-8dad294b44bf" returned: 0 in 0.259s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-e6519c19-9272-44e4-b0cf-8dad294b44bf" released by "delete_volume" :: held 0.691s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['b5511262-f3a7-4207-b70f-2709bc406bb8', '2b27fa4d-1a16-41f7-8adc-fd381dd4a5c4', '2a20d44c-ab23-43b3-adc6-4afeddede8b7', 'a91a2d66-d504-437d-957e-27f93daff10e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:19 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:19 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-9b5b447b-6619-46fc-a390-9705f5249aec-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:20 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.293s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:20 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleted volume successfully. Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-9b5b447b-6619-46fc-a390-9705f5249aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-665184a0-03a2-458a-8b82-4cc96cdffc38" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-665184a0-03a2-458a-8b82-4cc96cdffc38" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-9b5b447b-6619-46fc-a390-9705f5249aec" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-904d302b-767f-403c-844d-8faa0dba87dc tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-e6519c19-9272-44e4-b0cf-8dad294b44bf-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-9b5b447b-6619-46fc-a390-9705f5249aec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleting offline snapshot 9b5b447b-6619-46fc-a390-9705f5249aec of volume 665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] snapshot_file for this snap is: volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[252e3fad-f9ec-4ab5-84cc-fac8419de615]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:20 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec Sep 28 15:21:20 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665184a0-03a2-458a-8b82-4cc96cdffc38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6882cb-5d35-4cb0-b3fa-9dbb308c3951]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:20 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 Sep 28 15:21:20 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38" returned: 0 in 0.369s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec Sep 28 15:21:21 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec" returned: 0 in 0.351s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec Sep 28 15:21:21 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38.9b5b447b-6619-46fc-a390-9705f5249aec" returned: 0 in 0.242s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-9b5b447b-6619-46fc-a390-9705f5249aec" released by "_delete_snapshot" :: held 1.437s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-665184a0-03a2-458a-8b82-4cc96cdffc38" released by "delete_snapshot" :: held 1.461s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['0074bd8b-a664-4f17-9948-598c978deaf6', 'd3ee2cae-96e8-4420-be9d-2acbf24e70ca', '10fd6ffc-44db-465e-874e-ce675a3dca14', 'b5e5fbf4-ce4e-4f65-964d-0a691c8aff97'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Delete snapshot completed successfully. Sep 28 15:21:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c33beb43-ede7-4a1e-bdb9-d27e91237277 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-9b5b447b-6619-46fc-a390-9705f5249aec-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-665184a0-03a2-458a-8b82-4cc96cdffc38-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-665184a0-03a2-458a-8b82-4cc96cdffc38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "cinder-quobyte-665184a0-03a2-458a-8b82-4cc96cdffc38" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-665184a0-03a2-458a-8b82-4cc96cdffc38" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54cde30-1e93-4d3a-8c94-856029fa1ce6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 Sep 28 15:21:22 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38" returned: 0 in 0.367s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38 Sep 28 15:21:22 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-665184a0-03a2-458a-8b82-4cc96cdffc38" returned: 0 in 0.246s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-quobyte-665184a0-03a2-458a-8b82-4cc96cdffc38" released by "delete_volume" :: held 0.677s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Created reservations ['1ee9c5f0-dd7e-4ae8-8766-4b728a30357d', 'a8bfea7d-7fe7-4fe5-bfcd-81857a686fcb', 'ab1c2c74-131b-47b9-8fb4-cbd1d1caa84e', 'cb80cda1-703d-4b1a-9d63-2c81c05cde68'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:23 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.279s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Deleted volume successfully. Sep 28 15:21:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b582b01b-4d36-45e4-b9d0-fcf112bc8518 tempest-CreateVolumesFromSnapshotTest-2092677118 None] Lock "cinder-665184a0-03a2-458a-8b82-4cc96cdffc38-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Flow 'volume_create_manager' (bc87ff9f-b3b2-48a7-8122-dc7829c4ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021b9d71-348f-43a7-8f8a-01a1cd606316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021b9d71-348f-43a7-8f8a-01a1cd606316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-539495520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e7cf63-6a79-49e5-977e-1ee2ac870633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5549b738145242ffbf0534c75e60a776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:27Z,use_quota=True,user_id='9aa407b4d296468e846a90dc17006636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce67ebc7-7b69-4d0a-9965-a128ccb5e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce67ebc7-7b69-4d0a-9965-a128ccb5e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8861ae-fc44-470e-9529-8b54fc039ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8861ae-fc44-470e-9529-8b54fc039ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e7cf63-6a79-49e5-977e-1ee2ac870633', 'volume_name': 'volume-52e7cf63-6a79-49e5-977e-1ee2ac870633', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d5f6ac-017e-4302-af73-89e60d39cbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d5f6ac-017e-4302-af73-89e60d39cbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544ed1ed-2ebf-4267-bd14-0dfc80a11ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Volume 52e7cf63-6a79-49e5-977e-1ee2ac870633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e7cf63-6a79-49e5-977e-1ee2ac870633', 'volume_size': 1} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-539495520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e7cf63-6a79-49e5-977e-1ee2ac870633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5549b738145242ffbf0534c75e60a776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:27Z,use_quota=True,user_id='9aa407b4d296468e846a90dc17006636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Creating volume 52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:26 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:26 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 1073741824 Sep 28 15:21:26 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:27 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 1073741824" returned: 0 in 0.494s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:27 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:27 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:27 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.261s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544ed1ed-2ebf-4267-bd14-0dfc80a11ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e7cf63-6a79-49e5-977e-1ee2ac870633', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894d5656-ae36-4328-a4ed-524009b69aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Volume volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 (52e7cf63-6a79-49e5-977e-1ee2ac870633): created successfully Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894d5656-ae36-4328-a4ed-524009b69aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Flow 'volume_create_manager' (bc87ff9f-b3b2-48a7-8122-dc7829c4ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ecb1dade-285d-4516-9080-c9ca52f8b301 tempest-VolumeDependencyTests-822105881 None] Created volume successfully. Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Creating offline snapshot d3c13153-4a87-4633-baa8-2ae36cbc1ee3 of volume 52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0437f713-dbe2-42a5-be79-74e34558c696]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:29 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:29 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 1G Sep 28 15:21:29 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:29 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 1G" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 Sep 28 15:21:29 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3" returned: 0 in 0.301s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 is being set with open permissions: ugo+rw Sep 28 15:21:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 Sep 28 15:21:30 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3" returned: 0 in 0.267s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info Sep 28 15:21:30 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info" returned: 0 in 0.274s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info is being set with open permissions: ugo+rw Sep 28 15:21:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info Sep 28 15:21:30 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:31 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.info" returned: 0 in 0.256s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cc6f2fb8-b877-464e-8dce-ec424a3887b4 tempest-VolumeDependencyTests-822105881 None] Create snapshot completed successfully Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:INSERT=55,cinder:UPDATE=243,cinder:SELECT=164,cinder:DELETE=24 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Flow 'volume_create_manager' (bdc5a770-41e4-445b-be6e-eed5d8b7c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a0b02-dbf0-4937-9342-2196f2abb5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a0b02-dbf0-4937-9342-2196f2abb5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1848014324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5549b738145242ffbf0534c75e60a776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3c13153-4a87-4633-baa8-2ae36cbc1ee3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:33Z,use_quota=True,user_id='9aa407b4d296468e846a90dc17006636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535aa18f-b94b-43e7-be34-12658c77fc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535aa18f-b94b-43e7-be34-12658c77fc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6234d36e-efe2-4b64-b2e5-fe5eaae475b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6234d36e-efe2-4b64-b2e5-fe5eaae475b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781', 'volume_name': 'volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781', 'volume_size': 1, 'snapshot_id': 'd3c13153-4a87-4633-baa8-2ae36cbc1ee3'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d238fe36-fea9-4cc4-be00-9ba80ab540e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d238fe36-fea9-4cc4-be00-9ba80ab540e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bdfbb9-16f7-4d56-9265-6afd69c9be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Volume bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781', 'volume_size': 1, 'snapshot_id': 'd3c13153-4a87-4633-baa8-2ae36cbc1ee3'} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-quobyte-d3c13153-4a87-4633-baa8-2ae36cbc1ee3-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-d3c13153-4a87-4633-baa8-2ae36cbc1ee3-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Creating volume bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 from snapshot d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-quobyte-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] snapshot: d3c13153-4a87-4633-baa8-2ae36cbc1ee3, volume: bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b711cf3-7c26-49dd-9657-a459613e7e61]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:33 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 Sep 28 15:21:33 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:33 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3" returned: 0 in 0.420s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e7cf63-6a79-49e5-977e-1ee2ac870633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc08cedc-90fd-4a52-a36d-a7f9362e1888]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:33 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:33 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:33 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.425s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:21:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:33 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 Sep 28 15:21:33 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" returned: 0 in 6.313s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7647452f-3a5e-4756-a26a-8c33b2fa05b9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:40 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:40 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:40 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:40 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.577s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:21:40 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Converted 1024.00 MB image at 162.17 MB/s Sep 28 15:21:40 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 is being set with open permissions: ugo+rw Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:40 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 Sep 28 15:21:40 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:40 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.286s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:21:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:21:41 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" returned: 0 in 0.313s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" released by "_copy_volume_from_snapshot" :: held 8.159s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-d3c13153-4a87-4633-baa8-2ae36cbc1ee3-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" released by "_create_volume_from_snapshot" :: held 8.194s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.214s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bdfbb9-16f7-4d56-9265-6afd69c9be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781', 'volume_size': 1, 'snapshot_id': 'd3c13153-4a87-4633-baa8-2ae36cbc1ee3'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81c028d-3cd3-4015-b0a2-28db38aff546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Volume volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 (bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781): created successfully Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81c028d-3cd3-4015-b0a2-28db38aff546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Flow 'volume_create_manager' (bdc5a770-41e4-445b-be6e-eed5d8b7c616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e67e1a1c-1bbd-43b4-886b-2dd772008fb1 tempest-VolumeDependencyTests-822105881 None] Created volume successfully. Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-d3c13153-4a87-4633-baa8-2ae36cbc1ee3-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-d3c13153-4a87-4633-baa8-2ae36cbc1ee3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-quobyte-52e7cf63-6a79-49e5-977e-1ee2ac870633" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-52e7cf63-6a79-49e5-977e-1ee2ac870633" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-quobyte-d3c13153-4a87-4633-baa8-2ae36cbc1ee3" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-d3c13153-4a87-4633-baa8-2ae36cbc1ee3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Deleting offline snapshot d3c13153-4a87-4633-baa8-2ae36cbc1ee3 of volume 52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] snapshot_file for this snap is: volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67118d-e4a9-4215-995a-119cdfeeeea7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:41 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 Sep 28 15:21:41 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:41 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3" returned: 0 in 0.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e7cf63-6a79-49e5-977e-1ee2ac870633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aceb086-202d-4c3d-b93c-b3f71aa0a9e9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:42 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:42 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.384s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:42 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 Sep 28 15:21:42 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3" returned: 0 in 0.353s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:42 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3 Sep 28 15:21:42 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:42 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633.d3c13153-4a87-4633-baa8-2ae36cbc1ee3" returned: 0 in 0.263s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-d3c13153-4a87-4633-baa8-2ae36cbc1ee3" released by "_delete_snapshot" :: held 1.500s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-52e7cf63-6a79-49e5-977e-1ee2ac870633" released by "delete_snapshot" :: held 1.528s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Created reservations ['659e85fc-e440-453e-aae9-4bc3b3f85f9f', '77c2964c-0b14-40fb-a478-61f0b2903f3d', '367bd48c-77e1-4f29-ad5b-d62672022d20', '3c7a660e-8ff4-4c87-b1b6-11002f4e7637'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Delete snapshot completed successfully. Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-16941746-711d-489a-8348-48d340f3ed75 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-d3c13153-4a87-4633-baa8-2ae36cbc1ee3-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-52e7cf63-6a79-49e5-977e-1ee2ac870633-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-52e7cf63-6a79-49e5-977e-1ee2ac870633-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-quobyte-52e7cf63-6a79-49e5-977e-1ee2ac870633" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-52e7cf63-6a79-49e5-977e-1ee2ac870633" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de77db-82a7-4acd-8dc5-d86f5a8f5d50]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:43 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:43 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:44 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.439s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:44 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633 Sep 28 15:21:44 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:44 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-52e7cf63-6a79-49e5-977e-1ee2ac870633" returned: 0 in 0.293s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-52e7cf63-6a79-49e5-977e-1ee2ac870633" released by "delete_volume" :: held 0.806s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Created reservations ['e4d58c48-f492-4b2f-8614-1d5f03bd48aa', '9dfaef75-b5d0-489b-a1b1-ab1b3a57f562', 'e3f09071-fc53-4560-aca5-78f6da959f6e', '098eb260-ccbf-4e7f-bc3b-a5588de04fee'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:44 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:44 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Lock "cinder-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Acquiring lock "cinder-quobyte-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3eccf-0840-4bd1-9bad-605e8a775ab9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:44 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Deleted volume successfully. Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0dd786c3-2710-40c4-8c40-0109c5954886 tempest-VolumeDependencyTests-822105881 None] Lock "cinder-52e7cf63-6a79-49e5-977e-1ee2ac870633-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:45 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 Sep 28 15:21:45 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:45 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" returned: 0 in 0.419s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:45 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781 Sep 28 15:21:45 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:45 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" returned: 0 in 0.308s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Lock "cinder-quobyte-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781" released by "delete_volume" :: held 0.787s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Created reservations ['3aa38171-cdac-4035-a397-8d17c108bae0', '0dbf2d8d-b5e8-4d17-ae03-7fcd789f3ce0', '7b478c93-ceb7-4366-aca0-9a7e862252fb', '699f1554-1927-4f44-ab6b-fd8d4ad76bb1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:45 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:21:45 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:46 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.321s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:46 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Deleted volume successfully. Sep 28 15:21:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e2706937-d40f-43f2-8895-384ca9da932e tempest-VolumeDependencyTests-822105881 None] Lock "cinder-bb3ad4e0-be6a-4cd5-8850-cd4fbbc64781-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Flow 'volume_create_manager' (34213da0-ae93-4e51-9b8b-3c32ef24bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe83de6-3e91-483c-9253-f07eaaa23642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe83de6-3e91-483c-9253-f07eaaa23642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b99b4d-82fe-4c0c-bfec-087a620bf271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e773f3f61c0b42a789e625dcd370859b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:52Z,use_quota=True,user_id='ae8c35c1edef47c5b764993bb8bcc790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e5ae7a-8bbb-438c-b93d-6d77abfecea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e5ae7a-8bbb-438c-b93d-6d77abfecea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd402cbf-ea2d-48ad-8f89-24756cd119cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd402cbf-ea2d-48ad-8f89-24756cd119cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '75b99b4d-82fe-4c0c-bfec-087a620bf271', 'volume_name': 'volume-75b99b4d-82fe-4c0c-bfec-087a620bf271', 'volume_size': 1, 'image_id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba45eaf63a75c6427e4603092f2cbffe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e773f3f61c0b42a789e625dcd370859b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a7113fb38b50273d90475414aef29d784ea06286b4518e56664b417f8283d7e8756905ab2ff6244417799a16b2748d93627c14c8c314c6c529b706441d83b9fa', 'id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc/file', 'properties': {}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9aa485-43d6-406b-a419-37f635d05474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9aa485-43d6-406b-a419-37f635d05474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1428d92-aef8-486e-97ba-c8f49b291857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Volume 75b99b4d-82fe-4c0c-bfec-087a620bf271: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-75b99b4d-82fe-4c0c-bfec-087a620bf271', 'volume_size': 1, 'image_id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba45eaf63a75c6427e4603092f2cbffe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e773f3f61c0b42a789e625dcd370859b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a7113fb38b50273d90475414aef29d784ea06286b4518e56664b417f8283d7e8756905ab2ff6244417799a16b2748d93627c14c8c314c6c529b706441d83b9fa', 'id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc/file', 'properties': {}}, 'image_service': } Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Trying to clone 75b99b4d-82fe-4c0c-bfec-087a620bf271 from image c9a39eea-b206-498b-a8c4-a0ff0bb986bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:21:52 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7088b1b-68e8-4862-813d-d6280a47d9e6]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD Sep 28 15:21:52 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD Sep 28 15:21:53 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Temporary image c9a39eea-b206-498b-a8c4-a0ff0bb986bc is fetched for user ae8c35c1edef47c5b764993bb8bcc790. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[810c6387-95c4-442f-9ea1-2829f7bf93c4]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD Sep 28 15:21:53 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD Sep 28 15:21:54 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b99b4d-82fe-4c0c-bfec-087a620bf271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e773f3f61c0b42a789e625dcd370859b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:52Z,use_quota=True,user_id='ae8c35c1edef47c5b764993bb8bcc790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Creating volume 75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:21:54 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 1073741824 Sep 28 15:21:54 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 1073741824" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:21:54 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 0 in 0.256s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Attempting download of c9a39eea-b206-498b-a8c4-a0ff0bb986bc ((None, [{'url': 'file:///opt/stack/data/glance/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'metadata': {}}])) to volume 75b99b4d-82fe-4c0c-bfec-087a620bf271. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e49837-2db9-4e9d-a242-c00d3321deaa]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0 Sep 28 15:21:55 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0" returned: 0 in 0.351s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0 Sep 28 15:21:55 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0" returned: 1 in 0.397s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a39eea-b206-498b-a8c4-a0ff0bb986bc__mh_vbo0' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0bc12-4c49-43fa-9f7a-e4a3244e641a]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD Sep 28 15:21:55 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD Sep 28 15:21:56 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:56 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] c9a39eea-b206-498b-a8c4-a0ff0bb986bc was raw, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:21:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:21:56 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9a39eea-b206-498b-a8c4-a0ff0bb986bc_5n_pndiudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:21:57 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 1G Sep 28 15:21:57 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 1G" returned: 0 in 0.353s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45c531-73e1-4321-8c8d-2b70683885cf]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:21:57 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 0 in 0.447s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:21:58 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:58 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 1 in 0.386s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Downloaded image c9a39eea-b206-498b-a8c4-a0ff0bb986bc ((None, [{'url': 'file:///opt/stack/data/glance/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'metadata': {}}])) to volume 75b99b4d-82fe-4c0c-bfec-087a620bf271 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Temporary image c9a39eea-b206-498b-a8c4-a0ff0bb986bc for user ae8c35c1edef47c5b764993bb8bcc790 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Marking volume 75b99b4d-82fe-4c0c-bfec-087a620bf271 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Copying metadata from image c9a39eea-b206-498b-a8c4-a0ff0bb986bc to 75b99b4d-82fe-4c0c-bfec-087a620bf271. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Creating volume glance metadata for volume 75b99b4d-82fe-4c0c-bfec-087a620bf271 backed by image c9a39eea-b206-498b-a8c4-a0ff0bb986bc with: {'image_id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ba45eaf63a75c6427e4603092f2cbffe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1428d92-aef8-486e-97ba-c8f49b291857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b99b4d-82fe-4c0c-bfec-087a620bf271', 'volume_size': 1, 'image_id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba45eaf63a75c6427e4603092f2cbffe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e773f3f61c0b42a789e625dcd370859b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a7113fb38b50273d90475414aef29d784ea06286b4518e56664b417f8283d7e8756905ab2ff6244417799a16b2748d93627c14c8c314c6c529b706441d83b9fa', 'id': 'c9a39eea-b206-498b-a8c4-a0ff0bb986bc', 'created_at': datetime.datetime(2026, 9, 28, 13, 21, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 21, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9a39eea-b206-498b-a8c4-a0ff0bb986bc/file', 'properties': {}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4325d99-ac3f-49c8-84cb-5b70655b10c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:58 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Volume volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 (75b99b4d-82fe-4c0c-bfec-087a620bf271): created successfully Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4325d99-ac3f-49c8-84cb-5b70655b10c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Flow 'volume_create_manager' (34213da0-ae93-4e51-9b8b-3c32ef24bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5ace07cc-b10c-4240-be01-dd702674a1c8 tempest-VolumeImageDependencyTests-1825175803 None] Created volume successfully. Sep 28 15:21:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Acquiring lock "cinder-75b99b4d-82fe-4c0c-bfec-087a620bf271-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Lock "cinder-75b99b4d-82fe-4c0c-bfec-087a620bf271-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Acquiring lock "cinder-quobyte-75b99b4d-82fe-4c0c-bfec-087a620bf271" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Lock "cinder-quobyte-75b99b4d-82fe-4c0c-bfec-087a620bf271" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b74838-fd28-4d50-a448-e1847629ef36]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:59 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:21:59 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 0 in 0.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:22:00 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 1 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:00 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271 Sep 28 15:22:00 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:00 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-75b99b4d-82fe-4c0c-bfec-087a620bf271" returned: 0 in 0.259s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Lock "cinder-quobyte-75b99b4d-82fe-4c0c-bfec-087a620bf271" released by "delete_volume" :: held 1.098s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Created reservations ['32404bf8-9364-4e3a-a28b-45ac478018a0', 'd9a1e1ce-ff7c-4b38-8f4e-e91e5c44379d', '95fe55b1-d7ec-4007-b616-548bf71ac878', '09b614bd-a112-4da6-8326-4c923171bd05'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:01 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.270s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Deleted volume successfully. Sep 28 15:22:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b84d3580-7f50-46b7-94d5-5160ab1c1494 tempest-VolumeImageDependencyTests-1825175803 None] Lock "cinder-75b99b4d-82fe-4c0c-bfec-087a620bf271-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:10 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=37,cinder:DELETE=3,cinder:SELECT=23,cinder:INSERT=12 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:11 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=97,cinder:DELETE=6,cinder:SELECT=77,cinder:INSERT=25 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (f848dac6-196b-4f2d-b87d-77f1a9421114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bb2e31-b0b5-40ae-937b-bbdc2bf0be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bb2e31-b0b5-40ae-937b-bbdc2bf0be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-885952060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186fc092-ae6b-4bca-9422-d85ddae78018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:27Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e244369-5019-4627-bde3-da9331914db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e244369-5019-4627-bde3-da9331914db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2548f8-d2d1-429b-b1eb-66b169fc6c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2548f8-d2d1-429b-b1eb-66b169fc6c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186fc092-ae6b-4bca-9422-d85ddae78018', 'volume_name': 'volume-186fc092-ae6b-4bca-9422-d85ddae78018', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41a9ed9-4d89-4906-818a-fbd2a91fce79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41a9ed9-4d89-4906-818a-fbd2a91fce79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885e2c8f-d7e9-48de-93be-cc3273d22542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Volume 186fc092-ae6b-4bca-9422-d85ddae78018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186fc092-ae6b-4bca-9422-d85ddae78018', 'volume_size': 1} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-885952060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186fc092-ae6b-4bca-9422-d85ddae78018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:27Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Creating volume 186fc092-ae6b-4bca-9422-d85ddae78018 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:27 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:27 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 1073741824 Sep 28 15:22:27 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (6923d531-fe04-4382-9d2a-827eac067ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d22bfee-0333-4f70-a02c-f73667dfe76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d22bfee-0333-4f70-a02c-f73667dfe76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-519072031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decbe929-42b2-41bd-b597-4faef2eb537a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:27Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4124568a-bc11-47d3-acf7-90ecd6d4787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4124568a-bc11-47d3-acf7-90ecd6d4787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e77fc6-445e-4efb-be52-433f4ee0d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e77fc6-445e-4efb-be52-433f4ee0d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decbe929-42b2-41bd-b597-4faef2eb537a', 'volume_name': 'volume-decbe929-42b2-41bd-b597-4faef2eb537a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19155379-b64b-4639-8db4-f05ec68ee734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19155379-b64b-4639-8db4-f05ec68ee734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962be429-4216-447a-849b-fe6cfa66d351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume decbe929-42b2-41bd-b597-4faef2eb537a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decbe929-42b2-41bd-b597-4faef2eb537a', 'volume_size': 1} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (171838ae-5671-4e58-b43e-e48e98befbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3048e72-3acd-4159-a9c5-61c6004d2fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3048e72-3acd-4159-a9c5-61c6004d2fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1681863854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7743629f-491c-4aaf-90f7-f0f02d9850f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abbd801-5e88-4640-973f-1204569709a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abbd801-5e88-4640-973f-1204569709a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825f7ec9-3e58-4ec1-a7dd-ff43584c0b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825f7ec9-3e58-4ec1-a7dd-ff43584c0b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7743629f-491c-4aaf-90f7-f0f02d9850f1', 'volume_name': 'volume-7743629f-491c-4aaf-90f7-f0f02d9850f1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8091fcee-aa8f-491e-b2d9-51df5b0424df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8091fcee-aa8f-491e-b2d9-51df5b0424df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a066eb6f-0416-48b4-a4b6-2689a50447a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Volume 7743629f-491c-4aaf-90f7-f0f02d9850f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7743629f-491c-4aaf-90f7-f0f02d9850f1', 'volume_size': 1} Sep 28 15:22:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 1073741824" returned: 0 in 0.881s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 Sep 28 15:22:28 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Flow 'volume_create_manager' (b6f65845-e0bd-4948-8de0-adbe3ce97487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1573ac47-d462-4ac9-adf3-03566b0ee07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (1b6bc4f9-be91-4027-b3f3-4138bb55591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f94b12c-9173-4e42-813c-a7c90befb7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1573ac47-d462-4ac9-adf3-03566b0ee07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea205f7a-92ca-4cde-a483-c95a44d6bc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67813fd33e04c4bba06ef46587e27b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='52fea206c0a246fcb9aaab2900009052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f56acc-6e6b-4cb3-83d6-80d13e08b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f56acc-6e6b-4cb3-83d6-80d13e08b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed2adaa-a9e6-4c41-bad7-d48fe1b116bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed2adaa-a9e6-4c41-bad7-d48fe1b116bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea205f7a-92ca-4cde-a483-c95a44d6bc9c', 'volume_name': 'volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65551c1-bcbc-40bc-a64d-cd7d3fb16b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65551c1-bcbc-40bc-a64d-cd7d3fb16b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aa4d5f-55d4-4ec5-a291-ebc504a34549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Volume ea205f7a-92ca-4cde-a483-c95a44d6bc9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c', 'volume_size': 1} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f94b12c-9173-4e42-813c-a7c90befb7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138507921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5239ae85-ee21-4079-bfe0-705afa26428b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0935f4-d9d5-4b72-8a1a-6aaeca78cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0935f4-d9d5-4b72-8a1a-6aaeca78cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de7cd28-a67a-43b6-bbfa-0c2c69bca1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de7cd28-a67a-43b6-bbfa-0c2c69bca1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5239ae85-ee21-4079-bfe0-705afa26428b', 'volume_name': 'volume-5239ae85-ee21-4079-bfe0-705afa26428b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18645ad-8be5-423e-a624-3b0f330d8796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18645ad-8be5-423e-a624-3b0f330d8796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d065baa9-a915-4ca3-99d5-752284507f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Volume 5239ae85-ee21-4079-bfe0-705afa26428b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5239ae85-ee21-4079-bfe0-705afa26428b', 'volume_size': 1} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018" returned: 0 in 0.444s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-519072031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decbe929-42b2-41bd-b597-4faef2eb537a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:27Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating volume decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:28 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a 1073741824 Sep 28 15:22:28 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885e2c8f-d7e9-48de-93be-cc3273d22542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186fc092-ae6b-4bca-9422-d85ddae78018', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b81e89-14fb-4a98-b5d6-7d5a2df356ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Volume volume-186fc092-ae6b-4bca-9422-d85ddae78018 (186fc092-ae6b-4bca-9422-d85ddae78018): created successfully Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b81e89-14fb-4a98-b5d6-7d5a2df356ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (f848dac6-196b-4f2d-b87d-77f1a9421114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e7ddc885-4b37-46de-a236-f05eca3dde77 tempest-CreateVolumesFromImageTest-1134106767 None] Created volume successfully. Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (e49d1d2a-644e-496a-af0b-d876fe53a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cf12cc-39d6-4500-961f-b83e7265136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cf12cc-39d6-4500-961f-b83e7265136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343361034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fe16e9-c74b-4323-8aae-6cd580d5ad83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:29Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc23107-f389-4e97-8661-aec9c6cb1e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc23107-f389-4e97-8661-aec9c6cb1e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcbaa82-5cae-4d3d-9e96-12a999d51897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcbaa82-5cae-4d3d-9e96-12a999d51897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9fe16e9-c74b-4323-8aae-6cd580d5ad83', 'volume_name': 'volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd454ebc-f7e1-4220-805b-087526ece599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd454ebc-f7e1-4220-805b-087526ece599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5545555-4730-48d6-b468-3871e16de7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:28 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Volume d9fe16e9-c74b-4323-8aae-6cd580d5ad83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83', 'volume_size': 1} Sep 28 15:22:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:29 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a 1073741824" returned: 0 in 0.779s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (06b47a07-ac89-4b21-9a1b-f36b193b18b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815376c7-7055-4b09-a454-5ed01c0b4090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815376c7-7055-4b09-a454-5ed01c0b4090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-623239520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc56018d-8c6f-4034-8471-7b2a8c523aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:29Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbc40b1-36f4-4ef3-bdfd-b9d0e9ffc8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbc40b1-36f4-4ef3-bdfd-b9d0e9ffc8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819d7888-ea46-40ec-89bf-b2b2e8307228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819d7888-ea46-40ec-89bf-b2b2e8307228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc56018d-8c6f-4034-8471-7b2a8c523aa7', 'volume_name': 'volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d655d20a-4486-4cf1-83ef-46d08847452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d655d20a-4486-4cf1-83ef-46d08847452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297e9d66-6a6f-4725-b1e6-d881a2599d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Volume bc56018d-8c6f-4034-8471-7b2a8c523aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7', 'volume_size': 1} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:29 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a Sep 28 15:22:29 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:29 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a" returned: 0 in 0.328s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1681863854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7743629f-491c-4aaf-90f7-f0f02d9850f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Creating volume 7743629f-491c-4aaf-90f7-f0f02d9850f1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:29 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962be429-4216-447a-849b-fe6cfa66d351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decbe929-42b2-41bd-b597-4faef2eb537a', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47841bc6-6889-407a-80ea-641230be9de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:29 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 1073741824 Sep 28 15:22:29 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:29 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume volume-decbe929-42b2-41bd-b597-4faef2eb537a (decbe929-42b2-41bd-b597-4faef2eb537a): created successfully Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47841bc6-6889-407a-80ea-641230be9de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (6923d531-fe04-4382-9d2a-827eac067ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-719240e0-9ea2-4d53-a523-7b63937a364c tempest-CreateVolumesFromSnapshotTest-300019540 None] Created volume successfully. Sep 28 15:22:30 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 1073741824" returned: 0 in 0.570s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 Sep 28 15:22:30 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1" returned: 0 in 0.320s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea205f7a-92ca-4cde-a483-c95a44d6bc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67813fd33e04c4bba06ef46587e27b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='52fea206c0a246fcb9aaab2900009052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Creating volume ea205f7a-92ca-4cde-a483-c95a44d6bc9c {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:30 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:30 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c 1073741824 Sep 28 15:22:30 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a066eb6f-0416-48b4-a4b6-2689a50447a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7743629f-491c-4aaf-90f7-f0f02d9850f1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2481ca56-2684-4ab8-a722-cf1684277da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:30 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Volume volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 (7743629f-491c-4aaf-90f7-f0f02d9850f1): created successfully Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2481ca56-2684-4ab8-a722-cf1684277da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (171838ae-5671-4e58-b43e-e48e98befbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dada4e34-6e66-4d61-bb20-0d77c7a55ddf tempest-CreateVolumesFromImageTest-1134106767 None] Created volume successfully. Sep 28 15:22:31 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c 1073741824" returned: 0 in 0.546s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:31 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c Sep 28 15:22:31 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:31 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c" returned: 0 in 0.287s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138507921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5239ae85-ee21-4079-bfe0-705afa26428b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:28Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Creating volume 5239ae85-ee21-4079-bfe0-705afa26428b {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:31 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:31 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b 1073741824 Sep 28 15:22:31 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aa4d5f-55d4-4ec5-a291-ebc504a34549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dafa933-a846-4c17-b23f-e08114b4d478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:31 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Volume volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c (ea205f7a-92ca-4cde-a483-c95a44d6bc9c): created successfully Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dafa933-a846-4c17-b23f-e08114b4d478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:31 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Flow 'volume_create_manager' (b6f65845-e0bd-4948-8de0-adbe3ce97487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-305c584f-d246-47c5-844d-91f0b6cdd376 tempest-CinderUnicodeTest-1885588203 None] Created volume successfully. Sep 28 15:22:32 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b 1073741824" returned: 0 in 0.631s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:32 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b Sep 28 15:22:32 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Flow 'volume_create_manager' (e7024c2b-4aab-46f5-8e58-859297b49324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687c6058-3c19-4847-a942-088e7b2036d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687c6058-3c19-4847-a942-088e7b2036d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e002e6-77ad-4e06-8b64-24fe96311fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1d1ea8ccf1407eacc4c81745edd5dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:32Z,use_quota=True,user_id='a31bdff733e54705af227c08c3dc57f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9481ab37-0ab6-4250-8076-2a5513dc1191),volume_type_id=9481ab37-0ab6-4250-8076-2a5513dc1191)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb48569-39e1-4ff7-b885-6d40fdfbb191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb48569-39e1-4ff7-b885-6d40fdfbb191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8be9b58-e232-4f8f-b79b-0c4cea659beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:22:32 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b" returned: 0 in 0.367s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.882s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343361034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fe16e9-c74b-4323-8aae-6cd580d5ad83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:29Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Creating volume d9fe16e9-c74b-4323-8aae-6cd580d5ad83 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:32 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:32 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 1073741824 Sep 28 15:22:32 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d065baa9-a915-4ca3-99d5-752284507f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5239ae85-ee21-4079-bfe0-705afa26428b', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023dfde4-504d-49d3-b917-44931eede331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:32 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Volume volume-5239ae85-ee21-4079-bfe0-705afa26428b (5239ae85-ee21-4079-bfe0-705afa26428b): created successfully Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023dfde4-504d-49d3-b917-44931eede331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:32 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (1b6bc4f9-be91-4027-b3f3-4138bb55591e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-834ea3a6-de07-4f1e-814b-be64ba808738 tempest-CreateVolumesFromImageTest-1134106767 None] Created volume successfully. Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8be9b58-e232-4f8f-b79b-0c4cea659beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8e002e6-77ad-4e06-8b64-24fe96311fc3', 'volume_name': 'volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3', 'volume_size': 1, 'image_id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d75c9-ad03-4540-8c84-88250966a61b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b7f2c7b3b647c9fdf2dfd3c393511ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1d1ea8ccf1407eacc4c81745edd5dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f0156876d229e24df3c39350ccfbbf65ad2f28b19a5ff6a85d0bb93c9ce12d0d67909d4119af10d6fac04fde0170223d95013fa9bca2adfd12dff7ab905b4a9', 'id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff9d75c9-ad03-4540-8c84-88250966a61b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b7ec6b-a31b-4324-9a87-ec0e4e0cabd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b7ec6b-a31b-4324-9a87-ec0e4e0cabd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a88f024-fd36-46e1-97be-a170e668b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Volume e8e002e6-77ad-4e06-8b64-24fe96311fc3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3', 'volume_size': 1, 'image_id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d75c9-ad03-4540-8c84-88250966a61b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b7f2c7b3b647c9fdf2dfd3c393511ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1d1ea8ccf1407eacc4c81745edd5dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f0156876d229e24df3c39350ccfbbf65ad2f28b19a5ff6a85d0bb93c9ce12d0d67909d4119af10d6fac04fde0170223d95013fa9bca2adfd12dff7ab905b4a9', 'id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff9d75c9-ad03-4540-8c84-88250966a61b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Trying to clone e8e002e6-77ad-4e06-8b64-24fe96311fc3 from image ff9d75c9-ad03-4540-8c84-88250966a61b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d75c9-ad03-4540-8c84-88250966a61b', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:22:33 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f23b45-572b-4cf2-8e4b-3f2f39ce4063]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Flow 'volume_create_manager' (b84e57b9-9936-4086-afac-151d4a1bb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e845b43-1369-41f1-af08-b28d67da8d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD Sep 28 15:22:33 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e845b43-1369-41f1-af08-b28d67da8d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1302225445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a59c44d-e25d-436f-ae3d-77d98ea2fd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67813fd33e04c4bba06ef46587e27b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:33Z,use_quota=True,user_id='52fea206c0a246fcb9aaab2900009052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ce3b85-3b94-43c6-bb97-4eb3edbc33c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ce3b85-3b94-43c6-bb97-4eb3edbc33c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f6bee6-6e5f-44a1-81a1-644a08966c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f6bee6-6e5f-44a1-81a1-644a08966c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a59c44d-e25d-436f-ae3d-77d98ea2fd32', 'volume_name': 'volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e15f71b-5825-4369-bff9-71aeef320804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e15f71b-5825-4369-bff9-71aeef320804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e68e64-3aa3-478b-9260-29187be67337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:33 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Volume 5a59c44d-e25d-436f-ae3d-77d98ea2fd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32', 'volume_size': 1} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:33 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 1073741824" returned: 0 in 0.719s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:33 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 Sep 28 15:22:33 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD Sep 28 15:22:33 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83" returned: 0 in 0.292s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.364s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-623239520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc56018d-8c6f-4034-8471-7b2a8c523aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85deb1fa490949228b2025868edc41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:29Z,use_quota=True,user_id='9c8b96a307fe42cba0b4a352913f885e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Creating volume bc56018d-8c6f-4034-8471-7b2a8c523aa7 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:33 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5545555-4730-48d6-b468-3871e16de7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:33 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 1073741824 Sep 28 15:22:33 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:33 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e2644e-68a9-4405-9ee0-0aec480ddd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Volume volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 (d9fe16e9-c74b-4323-8aae-6cd580d5ad83): created successfully Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e2644e-68a9-4405-9ee0-0aec480ddd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (e49d1d2a-644e-496a-af0b-d876fe53a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c92aed3a-5cd3-4067-a1eb-abaf864cb48a tempest-CreateVolumesFromImageTest-1134106767 None] Created volume successfully. Sep 28 15:22:34 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Temporary image ff9d75c9-ad03-4540-8c84-88250966a61b is fetched for user a31bdff733e54705af227c08c3dc57f2. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8096e-a6e6-4ec8-a475-e2ccced44709]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:34 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD Sep 28 15:22:34 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:34 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 1073741824" returned: 0 in 0.619s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:34 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:34 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 Sep 28 15:22:34 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:34 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD Sep 28 15:22:34 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:34 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7" returned: 0 in 0.351s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.004s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297e9d66-6a6f-4725-b1e6-d881a2599d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e8ddd7-d28a-44ae-8b47-e9c9ffbe1461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating offline snapshot d91147b3-d5e1-4e13-92c2-b98a4ebfca28 of volume decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:35 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Volume volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 (bc56018d-8c6f-4034-8471-7b2a8c523aa7): created successfully Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e8ddd7-d28a-44ae-8b47-e9c9ffbe1461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:35 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Flow 'volume_create_manager' (06b47a07-ac89-4b21-9a1b-f36b193b18b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b644ba2-8ba6-44f7-a497-7d95eac5c361]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5f4696f8-f40b-4d02-8b79-2ab1c3045b0f tempest-CreateVolumesFromImageTest-1134106767 None] Created volume successfully. Sep 28 15:22:35 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a Sep 28 15:22:35 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:35 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a" returned: 0 in 0.476s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:35 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 1G Sep 28 15:22:35 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 1G" returned: 0 in 0.496s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decbe929-42b2-41bd-b597-4faef2eb537a -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decbe929-42b2-41bd-b597-4faef2eb537a -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 Sep 28 15:22:36 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-bc56018d-8c6f-4034-8471-7b2a8c523aa7-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-bc56018d-8c6f-4034-8471-7b2a8c523aa7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-quobyte-bc56018d-8c6f-4034-8471-7b2a8c523aa7" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-bc56018d-8c6f-4034-8471-7b2a8c523aa7" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4299f2f-3414-4cb6-8724-9e81a9869de7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 Sep 28 15:22:36 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decbe929-42b2-41bd-b597-4faef2eb537a -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28" returned: 0 in 0.396s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 is being set with open permissions: ugo+rw Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 Sep 28 15:22:36 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28" returned: 0 in 0.283s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7" returned: 0 in 0.490s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7 Sep 28 15:22:36 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:36 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info Sep 28 15:22:36 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bc56018d-8c6f-4034-8471-7b2a8c523aa7" returned: 0 in 0.318s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-bc56018d-8c6f-4034-8471-7b2a8c523aa7" released by "delete_volume" :: held 0.871s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:37 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info" returned: 0 in 0.315s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info is being set with open permissions: ugo+rw Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info Sep 28 15:22:37 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Created reservations ['d9ad06ac-8c1a-4bf3-a829-c26d864bb955', '55a81675-5713-4903-8610-0a743c9a0efc', 'e00174c8-2ccd-4f8e-896a-f1babfc3e924', '31cfc3fd-4396-4314-b764-352782b7f70f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:37 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-d9fe16e9-c74b-4323-8aae-6cd580d5ad83-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-d9fe16e9-c74b-4323-8aae-6cd580d5ad83-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:37 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.info" returned: 0 in 0.367s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1302225445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a59c44d-e25d-436f-ae3d-77d98ea2fd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67813fd33e04c4bba06ef46587e27b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:33Z,use_quota=True,user_id='52fea206c0a246fcb9aaab2900009052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Creating volume 5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:37 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 1073741824 Sep 28 15:22:37 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-quobyte-d9fe16e9-c74b-4323-8aae-6cd580d5ad83" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-d9fe16e9-c74b-4323-8aae-6cd580d5ad83" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6c7646a3-62da-4a84-9531-e7bc1c3a683f tempest-CreateVolumesFromSnapshotTest-300019540 None] Create snapshot completed successfully Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1adfeca-6922-4eff-87ec-5a8e53e7647e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:37 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.405s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Deleted volume successfully. Sep 28 15:22:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-38161685-5b56-49d4-b7c9-1aa2c22726aa tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-bc56018d-8c6f-4034-8471-7b2a8c523aa7-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:37 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 Sep 28 15:22:37 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 1073741824" returned: 0 in 0.550s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 Sep 28 15:22:38 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83" returned: 0 in 0.523s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83 Sep 28 15:22:38 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" returned: 0 in 0.300s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e002e6-77ad-4e06-8b64-24fe96311fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1d1ea8ccf1407eacc4c81745edd5dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:32Z,use_quota=True,user_id='a31bdff733e54705af227c08c3dc57f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9481ab37-0ab6-4250-8076-2a5513dc1191),volume_type_id=9481ab37-0ab6-4250-8076-2a5513dc1191)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Creating volume e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:38 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e68e64-3aa3-478b-9260-29187be67337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd0239-989d-4496-bc84-0d220000f51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:38 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 1073741824 Sep 28 15:22:38 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:38 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Volume volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 (5a59c44d-e25d-436f-ae3d-77d98ea2fd32): created successfully Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd0239-989d-4496-bc84-0d220000f51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Flow 'volume_create_manager' (b84e57b9-9936-4086-afac-151d4a1bb39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:38 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c2812167-d749-4045-9bc4-d7fc6a7f0704 tempest-CinderUnicodeTest-1885588203 None] Created volume successfully. Sep 28 15:22:38 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9fe16e9-c74b-4323-8aae-6cd580d5ad83" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-d9fe16e9-c74b-4323-8aae-6cd580d5ad83" released by "delete_volume" :: held 1.011s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Created reservations ['11c0b803-661a-490a-a6c7-a5bc546fe323', 'f2da1aaa-e92e-4cd8-be07-8bb9830342b0', '5684f082-3bba-4e8d-b80e-d2f2bb64537e', 'b1b41dac-df16-428e-844c-e7cbf4f0b947'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:38 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:38 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (fef03db3-b121-46f2-ac3b-6129883e43d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaf9597-d577-477d-9e74-c6431ec7b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.404s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:39 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 1073741824" returned: 0 in 0.757s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Deleted volume successfully. Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaf9597-d577-477d-9e74-c6431ec7b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495134582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff6e5cd-f2c9-40fc-b1d7-310b425853a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080241ef-b0ac-421f-a83e-a978879e64d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080241ef-b0ac-421f-a83e-a978879e64d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74da6027-3c4f-449a-ac47-15691692ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74da6027-3c4f-449a-ac47-15691692ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff6e5cd-f2c9-40fc-b1d7-310b425853a3', 'volume_name': 'volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a704afb-6329-4c18-af17-c4a026efc893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a704afb-6329-4c18-af17-c4a026efc893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12e9e59-2121-4b18-b6ce-fce0accee52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume bff6e5cd-f2c9-40fc-b1d7-310b425853a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3', 'volume_size': 1} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-44fc8bc7-fa22-45d7-ad5e-69bfb719ed92 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-d9fe16e9-c74b-4323-8aae-6cd580d5ad83-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:39 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:39 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (64c07a45-200c-4c95-b8f8-1776bc6e11d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ba44c5-f552-4581-9749-352d817fa265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 0 in 0.351s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495134582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff6e5cd-f2c9-40fc-b1d7-310b425853a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating volume bff6e5cd-f2c9-40fc-b1d7-310b425853a3 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:39 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ba44c5-f552-4581-9749-352d817fa265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611267829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9243b63-6630-451e-91f8-f0e4aa2e8331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94a8f85-7d36-40fb-9261-33b4f7f8752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 1073741824 Sep 28 15:22:39 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94a8f85-7d36-40fb-9261-33b4f7f8752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9070ffe-46ea-4665-ae84-b2c84dc6294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9070ffe-46ea-4665-ae84-b2c84dc6294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9243b63-6630-451e-91f8-f0e4aa2e8331', 'volume_name': 'volume-d9243b63-6630-451e-91f8-f0e4aa2e8331', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ddd7d0-693f-47db-a81a-f3ba6ea081ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ddd7d0-693f-47db-a81a-f3ba6ea081ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25610df7-80da-47a5-bb52-c0e4e62bca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume d9243b63-6630-451e-91f8-f0e4aa2e8331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9243b63-6630-451e-91f8-f0e4aa2e8331', 'volume_size': 1} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-5239ae85-ee21-4079-bfe0-705afa26428b-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Attempting download of ff9d75c9-ad03-4540-8c84-88250966a61b ((None, [{'url': 'file:///opt/stack/data/glance/images/ff9d75c9-ad03-4540-8c84-88250966a61b', 'metadata': {}}])) to volume e8e002e6-77ad-4e06-8b64-24fe96311fc3. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-5239ae85-ee21-4079-bfe0-705afa26428b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-quobyte-5239ae85-ee21-4079-bfe0-705afa26428b" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70f2a3-1565-4af1-836c-56c1b10b2247]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-5239ae85-ee21-4079-bfe0-705afa26428b" acquired by "delete_volume" :: waited 0.076s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d230bd3-7f0b-48d3-b1f4-cb5661541a70]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2 Sep 28 15:22:40 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (50af718b-e104-47f7-a9a0-f9d7783b4dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2b5483-a709-4a70-91d1-5900f2927aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2b5483-a709-4a70-91d1-5900f2927aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230871137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e43cdc3-039c-4c55-b857-e35cebaed1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:40Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b Sep 28 15:22:40 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a7bf405-c93e-44e6-b251-b1fd195723b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a7bf405-c93e-44e6-b251-b1fd195723b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1f5006-c1c3-45b4-99de-59139d95bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1f5006-c1c3-45b4-99de-59139d95bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e43cdc3-039c-4c55-b857-e35cebaed1a2', 'volume_name': 'volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636b8afd-ab54-45c8-9c7a-d07e613a84b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636b8afd-ab54-45c8-9c7a-d07e613a84b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37db826a-613a-45e8-aedb-3f7af92a309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume 6e43cdc3-039c-4c55-b857-e35cebaed1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2', 'volume_size': 1} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2" returned: 0 in 0.486s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 1073741824" returned: 0 in 0.929s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2 Sep 28 15:22:40 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:40 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 Sep 28 15:22:40 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b" returned: 0 in 0.736s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:40 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b Sep 28 15:22:40 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (aceaf205-d35a-4ae5-9235-ebf5c271093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7705d45d-3c5c-47ab-ad81-4f1b3edeb186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7705d45d-3c5c-47ab-ad81-4f1b3edeb186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1036469626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dc9133-41f8-4edc-ad01-60708b923228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:41Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2802d54-f680-432b-9eb7-fa77f4ee551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2802d54-f680-432b-9eb7-fa77f4ee551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d12cd8-f985-4b94-9131-e36d1aeda090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d12cd8-f985-4b94-9131-e36d1aeda090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dc9133-41f8-4edc-ad01-60708b923228', 'volume_name': 'volume-d3dc9133-41f8-4edc-ad01-60708b923228', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de42339a-653c-4370-a05f-e9b1b49a0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de42339a-653c-4370-a05f-e9b1b49a0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7eb562-b62a-4ed1-9c3b-ad5d9e9f2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume d3dc9133-41f8-4edc-ad01-60708b923228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dc9133-41f8-4edc-ad01-60708b923228', 'volume_size': 1} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3" returned: 0 in 0.459s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2" returned: 1 in 0.695s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff9d75c9-ad03-4540-8c84-88250966a61b_6f7nsyu2' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611267829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9243b63-6630-451e-91f8-f0e4aa2e8331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:39Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating volume d9243b63-6630-451e-91f8-f0e4aa2e8331 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:41 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:41 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7093ab2-9287-4bb7-92c6-1afdd67e717f]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 1073741824 Sep 28 15:22:41 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12e9e59-2121-4b18-b6ce-fce0accee52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126c4947-39be-4923-a75f-33ec6e542bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.664s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:22:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 (bff6e5cd-f2c9-40fc-b1d7-310b425853a3): created successfully Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126c4947-39be-4923-a75f-33ec6e542bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (fef03db3-b121-46f2-ac3b-6129883e43d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:41 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD Sep 28 15:22:41 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2d074818-f993-4215-835a-5053a919fe01 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created volume successfully. Sep 28 15:22:41 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5239ae85-ee21-4079-bfe0-705afa26428b" returned: 0 in 0.668s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-5239ae85-ee21-4079-bfe0-705afa26428b" released by "delete_volume" :: held 1.533s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Created reservations ['316f32aa-a4ee-41d5-ac4e-e4e44bd1ef6c', '70faae79-321f-4d98-a325-06e6572d5881', 'fbf5bf08-38ac-45dd-932c-bc6580c7c1f4', '7febc7a0-2702-43d4-976a-adfea3a73571'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:41 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (be860b83-323b-46f2-9a11-f6c248933542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738aa4de-27cd-40c6-9032-19bb193e0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:41 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD Sep 28 15:22:41 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738aa4de-27cd-40c6-9032-19bb193e0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93482970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2a23ce-04a3-4840-9019-9b4197ccc3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:42Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:41 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f88fa0-3480-4046-bfc8-3e2fbe25c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f88fa0-3480-4046-bfc8-3e2fbe25c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ee987-39f9-4be1-ab1c-7ea6d1a21fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ee987-39f9-4be1-ab1c-7ea6d1a21fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2a23ce-04a3-4840-9019-9b4197ccc3ec', 'volume_name': 'volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec80c4f1-c14d-4d6f-91c4-cfcfdef16572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec80c4f1-c14d-4d6f-91c4-cfcfdef16572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb003c9-a376-4952-8150-6baa70febbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume ea2a23ce-04a3-4840-9019-9b4197ccc3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec', 'volume_size': 1} Sep 28 15:22:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:42 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 1073741824" returned: 0 in 0.838s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 Sep 28 15:22:42 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] ff9d75c9-ad03-4540-8c84-88250966a61b was raw, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:42 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Deleted volume successfully. Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0b2dd1e-e8c3-4bb2-adfb-68d214c25fad tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-5239ae85-ee21-4079-bfe0-705afa26428b-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:42 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331" returned: 0 in 0.300s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.980s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230871137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e43cdc3-039c-4c55-b857-e35cebaed1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:40Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating volume 6e43cdc3-039c-4c55-b857-e35cebaed1a2 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:42 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25610df7-80da-47a5-bb52-c0e4e62bca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9243b63-6630-451e-91f8-f0e4aa2e8331', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 1073741824 Sep 28 15:22:42 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fda23b5-8548-4aa6-a5da-983347b5c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:42 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 (d9243b63-6630-451e-91f8-f0e4aa2e8331): created successfully Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fda23b5-8548-4aa6-a5da-983347b5c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (64c07a45-200c-4c95-b8f8-1776bc6e11d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-31d35ebe-3eec-4d8f-bac7-135b170bfa43 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created volume successfully. Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-7743629f-491c-4aaf-90f7-f0f02d9850f1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-7743629f-491c-4aaf-90f7-f0f02d9850f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-quobyte-7743629f-491c-4aaf-90f7-f0f02d9850f1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-7743629f-491c-4aaf-90f7-f0f02d9850f1" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5c98d-8e5c-413c-aaf4-bc8d2618112a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 0 in 0.523s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff9d75c9-ad03-4540-8c84-88250966a61b_979ujbmfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:22:42 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:22:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:42 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 1G Sep 28 15:22:42 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:42 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 Sep 28 15:22:42 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 1073741824" returned: 0 in 0.642s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 1G" returned: 0 in 0.394s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 Sep 28 15:22:43 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3de8f0-df31-4371-a3f1-4d4e0dcd439d]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1" returned: 0 in 0.511s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1 Sep 28 15:22:43 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:43 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2" returned: 0 in 0.333s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.979s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37db826a-613a-45e8-aedb-3f7af92a309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e96e9af-ba59-4faf-849d-091f01e8d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:43 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Creating offline snapshot 501daf6d-89d1-42a1-a312-8cd7eb739274 of volume 5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-7743629f-491c-4aaf-90f7-f0f02d9850f1" returned: 0 in 0.275s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5a7b1-d927-4138-b566-4e9115bbfcad]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-7743629f-491c-4aaf-90f7-f0f02d9850f1" released by "delete_volume" :: held 0.873s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:43 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 (6e43cdc3-039c-4c55-b857-e35cebaed1a2): created successfully Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e96e9af-ba59-4faf-849d-091f01e8d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (50af718b-e104-47f7-a9a0-f9d7783b4dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4145de8c-a53c-4be3-b678-2e3429a4e50e tempest-CreateVolumesFromSnapshotTest-300019540 None] Created volume successfully. Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Created reservations ['988c491c-0de8-4c97-80e2-e50c8b04f574', '8d99c5f4-950f-4fd7-a962-5b7a94f8f094', '9aa12065-6d7a-40cd-ba0f-f39782f30802', 'a9ca1f58-0841-4a0d-8e7e-2c5c1cd5bed6'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:43 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 0 in 0.501s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 Sep 28 15:22:43 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:43 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:43 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-186fc092-ae6b-4bca-9422-d85ddae78018-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:43 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:43 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-186fc092-ae6b-4bca-9422-d85ddae78018-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "cinder-quobyte-186fc092-ae6b-4bca-9422-d85ddae78018" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-186fc092-ae6b-4bca-9422-d85ddae78018" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb923828-7230-4baa-90a2-f8ea6dc734b3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" returned: 0 in 0.636s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:44 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 1G Sep 28 15:22:44 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Deleted volume successfully. Sep 28 15:22:44 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 Sep 28 15:22:44 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-287b0cc5-073e-434f-8689-e809d685dc32 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-7743629f-491c-4aaf-90f7-f0f02d9850f1-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:44 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 1 in 0.662s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Downloaded image ff9d75c9-ad03-4540-8c84-88250966a61b ((None, [{'url': 'file:///opt/stack/data/glance/images/ff9d75c9-ad03-4540-8c84-88250966a61b', 'metadata': {}}])) to volume e8e002e6-77ad-4e06-8b64-24fe96311fc3 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Temporary image ff9d75c9-ad03-4540-8c84-88250966a61b for user a31bdff733e54705af227c08c3dc57f2 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Marking volume e8e002e6-77ad-4e06-8b64-24fe96311fc3 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Copying metadata from image ff9d75c9-ad03-4540-8c84-88250966a61b to e8e002e6-77ad-4e06-8b64-24fe96311fc3. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Creating volume glance metadata for volume e8e002e6-77ad-4e06-8b64-24fe96311fc3 backed by image ff9d75c9-ad03-4540-8c84-88250966a61b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3b7f2c7b3b647c9fdf2dfd3c393511ed', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a88f024-fd36-46e1-97be-a170e668b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3', 'volume_size': 1, 'image_id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff9d75c9-ad03-4540-8c84-88250966a61b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b7f2c7b3b647c9fdf2dfd3c393511ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f1d1ea8ccf1407eacc4c81745edd5dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f0156876d229e24df3c39350ccfbbf65ad2f28b19a5ff6a85d0bb93c9ce12d0d67909d4119af10d6fac04fde0170223d95013fa9bca2adfd12dff7ab905b4a9', 'id': 'ff9d75c9-ad03-4540-8c84-88250966a61b', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff9d75c9-ad03-4540-8c84-88250966a61b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04827cb1-1faf-496e-8ded-a7ee08eb216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:44 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Volume volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 (e8e002e6-77ad-4e06-8b64-24fe96311fc3): created successfully Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04827cb1-1faf-496e-8ded-a7ee08eb216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Flow 'volume_create_manager' (e7024c2b-4aab-46f5-8e58-859297b49324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-18cd1a94-d210-4b8d-82e9-df4eba2e36f3 tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Created volume successfully. Sep 28 15:22:44 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018" returned: 0 in 0.448s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018 Sep 28 15:22:44 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 1G" returned: 0 in 0.560s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:44 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 Sep 28 15:22:44 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:44 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-186fc092-ae6b-4bca-9422-d85ddae78018" returned: 0 in 0.290s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-quobyte-186fc092-ae6b-4bca-9422-d85ddae78018" released by "delete_volume" :: held 0.825s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:44 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Created reservations ['795de370-5353-4f01-a124-a5eed8e8d9ff', '65ba1219-9ac9-4e35-83f6-04b6f2455b29', '344602ec-27f3-4153-9fcf-e2d24de0e992', '1c23bf2f-bb4d-46cf-af3b-fdf37fc159f9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:45 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Acquiring lock "cinder-e8e002e6-77ad-4e06-8b64-24fe96311fc3-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "cinder-e8e002e6-77ad-4e06-8b64-24fe96311fc3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Acquiring lock "cinder-quobyte-e8e002e6-77ad-4e06-8b64-24fe96311fc3" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:45 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "cinder-quobyte-e8e002e6-77ad-4e06-8b64-24fe96311fc3" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274" returned: 0 in 0.609s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 is being set with open permissions: ugo+rw Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880c647-7467-4373-bc29-ee8d3d694aa5]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 Sep 28 15:22:45 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.350s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Deleted volume successfully. Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-65ae0ee7-f8f4-430c-9d3b-581375fb0b40 tempest-CreateVolumesFromImageTest-1134106767 None] Lock "cinder-186fc092-ae6b-4bca-9422-d85ddae78018-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:45 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:45 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274" returned: 0 in 0.330s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info Sep 28 15:22:45 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:45 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 0 in 0.470s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:45 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:45 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info" returned: 0 in 0.327s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info is being set with open permissions: ugo+rw Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info Sep 28 15:22:46 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 1 in 0.440s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3 Sep 28 15:22:46 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.info" returned: 0 in 0.343s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.228s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1036469626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dc9133-41f8-4edc-ad01-60708b923228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:41Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating volume d3dc9133-41f8-4edc-ad01-60708b923228 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:46 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 1073741824 Sep 28 15:22:46 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-68a7683f-71b4-4880-a067-2271c41abcbc tempest-CinderUnicodeTest-1885588203 None] Create snapshot completed successfully Sep 28 15:22:46 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e8e002e6-77ad-4e06-8b64-24fe96311fc3" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "cinder-quobyte-e8e002e6-77ad-4e06-8b64-24fe96311fc3" released by "delete_volume" :: held 1.379s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Created reservations ['e5affb8f-90b5-4d54-b479-5ddd481acac9', '007e0d87-09ab-4fad-af48-f09cef6e294c', '0f5c43ba-9970-4acc-834c-87f05dd42a23', '7bb0cb7f-a614-49cf-82bc-a42e2cb03ae9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-501daf6d-89d1-42a1-a312-8cd7eb739274-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:46 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:46 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-501daf6d-89d1-42a1-a312-8cd7eb739274-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-quobyte-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-quobyte-501daf6d-89d1-42a1-a312-8cd7eb739274" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-501daf6d-89d1-42a1-a312-8cd7eb739274" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Deleting offline snapshot 501daf6d-89d1-42a1-a312-8cd7eb739274 of volume 5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] snapshot_file for this snap is: volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a42ec80-073e-4959-a4c3-216f156481d4]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 1073741824" returned: 0 in 0.687s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 Sep 28 15:22:47 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.373s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Deleted volume successfully. Sep 28 15:22:47 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 Sep 28 15:22:47 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c37709a9-da31-47ce-ab7f-dbd9f0fbd3ac tempest-VolumeAndVolumeTypeFromImageTest-315214329 None] Lock "cinder-e8e002e6-77ad-4e06-8b64-24fe96311fc3-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:47 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228" returned: 0 in 0.352s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.555s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93482970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2a23ce-04a3-4840-9019-9b4197ccc3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92c7ef5e85842f8824f80dd4dd791fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:42Z,use_quota=True,user_id='cdf24df394e94a8b9b6c85a95ed09618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Creating volume ea2a23ce-04a3-4840-9019-9b4197ccc3ec {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:47 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274" returned: 0 in 0.512s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:22:47 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec 1073741824 Sep 28 15:22:47 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7eb562-b62a-4ed1-9c3b-ad5d9e9f2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dc9133-41f8-4edc-ad01-60708b923228', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101573b8-6d02-4ccc-b1b4-3b745a635fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cef270-8831-42c4-865b-120d579bf7cd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume volume-d3dc9133-41f8-4edc-ad01-60708b923228 (d3dc9133-41f8-4edc-ad01-60708b923228): created successfully Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101573b8-6d02-4ccc-b1b4-3b745a635fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (aceaf205-d35a-4ae5-9235-ebf5c271093f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-04974300-63fb-4324-8ba3-ccbdbc588ced tempest-CreateVolumesFromSnapshotTest-300019540 None] Created volume successfully. Sep 28 15:22:47 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 Sep 28 15:22:47 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec 1073741824" returned: 0 in 0.639s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" returned: 0 in 0.624s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 Sep 28 15:22:48 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec Sep 28 15:22:48 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec" returned: 0 in 0.397s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb003c9-a376-4952-8150-6baa70febbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d543aa-48dc-4eef-a3cf-8405498b3600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Volume volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec (ea2a23ce-04a3-4840-9019-9b4197ccc3ec): created successfully Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d543aa-48dc-4eef-a3cf-8405498b3600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Flow 'volume_create_manager' (be860b83-323b-46f2-9a11-f6c248933542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:48 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ce1b19ee-a182-4691-8b7e-da38fb68068a tempest-CreateVolumesFromSnapshotTest-300019540 None] Created volume successfully. Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274" returned: 0 in 0.504s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274 Sep 28 15:22:48 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:49 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32.501daf6d-89d1-42a1-a312-8cd7eb739274" returned: 0 in 0.373s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-501daf6d-89d1-42a1-a312-8cd7eb739274" released by "_delete_snapshot" :: held 2.210s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" released by "delete_snapshot" :: held 2.262s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Created reservations ['5ad65227-3aa7-47f6-a289-2fb364e1354c', '3b91d658-c096-47d1-8761-59b29ae15ca0', '475efdfa-b562-4731-95ae-25be2951eb13', '15adaa5a-98d8-494b-a07d-c2689bd96384'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Delete snapshot completed successfully. Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d9893917-528f-41cf-aaee-6e1eb78a19a4 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-501daf6d-89d1-42a1-a312-8cd7eb739274-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-ea2a23ce-04a3-4840-9019-9b4197ccc3ec-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-ea2a23ce-04a3-4840-9019-9b4197ccc3ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-ea2a23ce-04a3-4840-9019-9b4197ccc3ec" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-ea2a23ce-04a3-4840-9019-9b4197ccc3ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff198807-241c-4ffa-b328-e267a52ced1c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec Sep 28 15:22:50 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-5a59c44d-e25d-436f-ae3d-77d98ea2fd32-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-5a59c44d-e25d-436f-ae3d-77d98ea2fd32-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-quobyte-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" acquired by "delete_volume" :: waited 0.049s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5296ae-1900-4ccf-8cfd-044ddac277eb]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec" returned: 0 in 0.612s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 Sep 28 15:22:50 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec Sep 28 15:22:50 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (55155467-1a89-4597-a29f-a617694eaf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073bf640-577b-4f98-8a91-c51b15a3b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073bf640-577b-4f98-8a91-c51b15a3b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084561157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435cf406-501d-468f-8b57-8af5feb50c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:51Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e05e18-9bb3-4e20-8b59-f3158e65c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e05e18-9bb3-4e20-8b59-f3158e65c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0641d256-fe10-4759-be92-7888ff97c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0641d256-fe10-4759-be92-7888ff97c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435cf406-501d-468f-8b57-8af5feb50c95', 'volume_name': 'volume-435cf406-501d-468f-8b57-8af5feb50c95', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b170b6-08e7-4cff-ba08-8557d9a0410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b170b6-08e7-4cff-ba08-8557d9a0410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911073dc-b2cd-48fb-8ee1-0b9b30cecace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:50 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume 435cf406-501d-468f-8b57-8af5feb50c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435cf406-501d-468f-8b57-8af5feb50c95', 'volume_size': 1} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084561157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435cf406-501d-468f-8b57-8af5feb50c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:51Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Creating volume 435cf406-501d-468f-8b57-8af5feb50c95 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:50 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:50 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 1073741824 Sep 28 15:22:50 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:50 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea2a23ce-04a3-4840-9019-9b4197ccc3ec" returned: 0 in 0.347s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-ea2a23ce-04a3-4840-9019-9b4197ccc3ec" released by "delete_volume" :: held 1.031s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" returned: 0 in 0.576s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['f608e07d-e6e4-4f5a-8c4d-7f74ab2942fb', 'd947d1c4-897f-4bd2-ba93-3d1cc2de2cfd', '2701db03-8dd3-4aa6-9b1a-02b91acba1d3', 'adc12c1a-640c-42dd-a190-59947187bc3d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:51 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32 Sep 28 15:22:51 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:51 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" returned: 0 in 0.433s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-5a59c44d-e25d-436f-ae3d-77d98ea2fd32" released by "delete_volume" :: held 1.138s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Created reservations ['1aa92cc7-a15a-43e7-b860-8ad394610db9', 'c85f5a12-8e7a-480e-8aef-96f53deacd95', 'c16001aa-b212-4f85-bec8-f120e4c44b21', 'a8267bd4-6e79-4f31-aeef-22482bc6ff42'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:51 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 1073741824" returned: 0 in 0.763s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.465s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleted volume successfully. Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b5406a77-986c-4d2c-b824-3044e215f609 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-ea2a23ce-04a3-4840-9019-9b4197ccc3ec-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:51 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 Sep 28 15:22:51 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:51 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:51 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95" returned: 0 in 0.357s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911073dc-b2cd-48fb-8ee1-0b9b30cecace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435cf406-501d-468f-8b57-8af5feb50c95', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11cd0d9-994a-47a8-9560-d6584fd55240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:52 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume volume-435cf406-501d-468f-8b57-8af5feb50c95 (435cf406-501d-468f-8b57-8af5feb50c95): created successfully Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11cd0d9-994a-47a8-9560-d6584fd55240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (55155467-1a89-4597-a29f-a617694eaf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e1e4d00b-1007-430d-886f-77b09cb3fe43 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created volume successfully. Sep 28 15:22:52 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.436s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:52 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Deleted volume successfully. Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2cbd2238-0218-476f-9bc9-5a58268713fe tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-5a59c44d-e25d-436f-ae3d-77d98ea2fd32-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-d3dc9133-41f8-4edc-ad01-60708b923228-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-d3dc9133-41f8-4edc-ad01-60708b923228-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-d3dc9133-41f8-4edc-ad01-60708b923228" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-d3dc9133-41f8-4edc-ad01-60708b923228" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab4a19-bfd9-48b7-889d-edd115c4835a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 Sep 28 15:22:52 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-ea205f7a-92ca-4cde-a483-c95a44d6bc9c-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-ea205f7a-92ca-4cde-a483-c95a44d6bc9c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "cinder-quobyte-ea205f7a-92ca-4cde-a483-c95a44d6bc9c" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-ea205f7a-92ca-4cde-a483-c95a44d6bc9c" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edb3c76-239a-42dc-855d-1795444982c2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228" returned: 0 in 0.542s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:52 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c Sep 28 15:22:52 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:52 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228 Sep 28 15:22:52 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d3dc9133-41f8-4edc-ad01-60708b923228" returned: 0 in 0.357s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-d3dc9133-41f8-4edc-ad01-60708b923228" released by "delete_volume" :: held 0.973s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:53 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c" returned: 0 in 0.603s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:53 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c Sep 28 15:22:53 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['1dc4eeeb-5770-44b4-984e-dff3f5033c42', '8ea1a110-98d6-4c7f-9c5e-a864194481af', '6dc2c2b5-8fd2-4056-a9eb-dec91e5f8df9', 'd437441a-41d4-4f43-960b-ceb5d1ffd4d1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (b6d4c625-058e-401f-9adf-a2e53cab9223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80873c62-fd57-4cdf-a78f-4efcef37848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80873c62-fd57-4cdf-a78f-4efcef37848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065592890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f90911d-c26f-45d4-919b-a366610be2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:53Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:53 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b077121-5a50-42d3-afe6-aa9ff03dd105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:53 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b077121-5a50-42d3-afe6-aa9ff03dd105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d708ed5f-843a-4fa4-b412-ea1c9fb7ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d708ed5f-843a-4fa4-b412-ea1c9fb7ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f90911d-c26f-45d4-919b-a366610be2a7', 'volume_name': 'volume-4f90911d-c26f-45d4-919b-a366610be2a7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a5f603-f3d2-4bcd-a8d1-a45d7f4760e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a5f603-f3d2-4bcd-a8d1-a45d7f4760e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac657115-e441-491b-9277-c1bca5926a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:53 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume 4f90911d-c26f-45d4-919b-a366610be2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f90911d-c26f-45d4-919b-a366610be2a7', 'volume_size': 1} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065592890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f90911d-c26f-45d4-919b-a366610be2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:53Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Creating volume 4f90911d-c26f-45d4-919b-a366610be2a7 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:53 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:53 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 1073741824 Sep 28 15:22:53 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:53 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-ea205f7a-92ca-4cde-a483-c95a44d6bc9c" returned: 0 in 0.457s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-quobyte-ea205f7a-92ca-4cde-a483-c95a44d6bc9c" released by "delete_volume" :: held 1.130s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:53 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Created reservations ['7460c4f8-3c73-42fd-a8cb-c08898ff728b', '27b7f54f-028f-43fe-98cd-d74e351cda0c', 'f3fd0d1f-75bb-4e0a-9fce-282dd71f99f8', '52172d91-06d5-4879-b3e4-d958ad28eec1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:54 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:54 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.571s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleted volume successfully. Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-46f522a6-10a0-40b6-9a45-735831c1d17f tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-d3dc9133-41f8-4edc-ad01-60708b923228-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (90470192-440b-457d-9e6c-0ffa501a6231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39235a23-cb10-4d1c-8a11-1b7331b57395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39235a23-cb10-4d1c-8a11-1b7331b57395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904174076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feec2fb-abe0-4b77-86aa-539acf99ebc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:54Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d213611-5f84-4ba7-b248-f5ca816bef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d213611-5f84-4ba7-b248-f5ca816bef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19396a8-68c0-4711-a81b-09a3be5ed006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19396a8-68c0-4711-a81b-09a3be5ed006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5feec2fb-abe0-4b77-86aa-539acf99ebc9', 'volume_name': 'volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9a8276-8714-486d-be9d-80e4ed63bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9a8276-8714-486d-be9d-80e4ed63bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703bfdf6-f9b5-4a00-b63d-51ad443bf278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:54 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:54 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume 5feec2fb-abe0-4b77-86aa-539acf99ebc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9', 'volume_size': 1} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 1073741824" returned: 0 in 0.822s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.471s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:54 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Deleted volume successfully. Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-33df2a12-a1bd-433e-92ff-fb74958ada76 tempest-CinderUnicodeTest-1885588203 None] Lock "cinder-ea205f7a-92ca-4cde-a483-c95a44d6bc9c-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-6e43cdc3-039c-4c55-b857-e35cebaed1a2-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-6e43cdc3-039c-4c55-b857-e35cebaed1a2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:54 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 Sep 28 15:22:54 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-6e43cdc3-039c-4c55-b857-e35cebaed1a2" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-6e43cdc3-039c-4c55-b857-e35cebaed1a2" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5081df7-44a2-419a-8a64-ace065624e30]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (c0121feb-c879-4078-8d3c-9c532cb41b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099365c1-f3f8-4c06-9004-210aee22a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099365c1-f3f8-4c06-9004-210aee22a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726184872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00173086-df5e-47a5-8d9a-de30b2665e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:55Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f5dff1-41b8-46cd-a9ef-025109c93754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f5dff1-41b8-46cd-a9ef-025109c93754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bf1e19-f7c6-4c49-b47e-bf40c7142f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bf1e19-f7c6-4c49-b47e-bf40c7142f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00173086-df5e-47a5-8d9a-de30b2665e88', 'volume_name': 'volume-00173086-df5e-47a5-8d9a-de30b2665e88', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a76f5e1-cb03-4e3a-bda1-2db3336d13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a76f5e1-cb03-4e3a-bda1-2db3336d13fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2549cb0-398f-4d70-a68b-9910bf70d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume 00173086-df5e-47a5-8d9a-de30b2665e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00173086-df5e-47a5-8d9a-de30b2665e88', 'volume_size': 1} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7" returned: 0 in 0.544s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904174076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feec2fb-abe0-4b77-86aa-539acf99ebc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:54Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Creating volume 5feec2fb-abe0-4b77-86aa-539acf99ebc9 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:55 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac657115-e441-491b-9277-c1bca5926a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f90911d-c26f-45d4-919b-a366610be2a7', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e330e94-2c7e-4f18-80d5-767d08eb8817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 1073741824 Sep 28 15:22:55 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume volume-4f90911d-c26f-45d4-919b-a366610be2a7 (4f90911d-c26f-45d4-919b-a366610be2a7): created successfully Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e330e94-2c7e-4f18-80d5-767d08eb8817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (b6d4c625-058e-401f-9adf-a2e53cab9223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bfe6c7ea-1428-4083-a123-0afb14bb52be tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created volume successfully. Sep 28 15:22:55 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2" returned: 0 in 0.674s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2 Sep 28 15:22:55 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:55 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (2e7745f6-45fc-4ac8-ab8d-78434a59a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b90e0-c410-48fc-b084-1cea3f237b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6e43cdc3-039c-4c55-b857-e35cebaed1a2" returned: 0 in 0.495s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b90e0-c410-48fc-b084-1cea3f237b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595181193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28191766-e0f5-4043-ba9a-8ac5745bf73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:56Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b435d2e-eed7-42d8-a633-681fabfba268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b435d2e-eed7-42d8-a633-681fabfba268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8471ee3a-3ca2-4920-8e00-649056ef2151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8471ee3a-3ca2-4920-8e00-649056ef2151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28191766-e0f5-4043-ba9a-8ac5745bf73f', 'volume_name': 'volume-28191766-e0f5-4043-ba9a-8ac5745bf73f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a69f9-9444-4841-9562-94ab01878641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a69f9-9444-4841-9562-94ab01878641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edd99c6-5140-4f3d-a84a-3f04dcf08708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume 28191766-e0f5-4043-ba9a-8ac5745bf73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28191766-e0f5-4043-ba9a-8ac5745bf73f', 'volume_size': 1} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-6e43cdc3-039c-4c55-b857-e35cebaed1a2" released by "delete_volume" :: held 1.343s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:56 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 1073741824" returned: 0 in 0.924s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 Sep 28 15:22:56 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['5f49e770-8f45-4504-bfb3-876bad762cf3', '10ccd758-a75f-4e61-a633-557f41742f75', '1dc8e3ac-29cf-45f3-b2c5-f9634c22a0b7', '0358ca02-9968-465b-a6fc-35c0c69abc93'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:56 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9" returned: 0 in 0.341s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.399s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726184872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00173086-df5e-47a5-8d9a-de30b2665e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:55Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Creating volume 00173086-df5e-47a5-8d9a-de30b2665e88 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:56 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703bfdf6-f9b5-4a00-b63d-51ad443bf278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 1073741824 Sep 28 15:22:56 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1534d7d1-2a8a-4fa5-8666-2d2ee8f08540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 (5feec2fb-abe0-4b77-86aa-539acf99ebc9): created successfully Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1534d7d1-2a8a-4fa5-8666-2d2ee8f08540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (90470192-440b-457d-9e6c-0ffa501a6231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (232446c5-9525-44d5-9178-cb4184854e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335a4bf4-a042-4c00-aed5-8d3d3aad348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.406s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-efb60f71-eec5-492e-8b45-705bd6ffd0de tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created volume successfully. Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335a4bf4-a042-4c00-aed5-8d3d3aad348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926096907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5622a9f9-7b36-4622-9f6a-3add91485411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:57Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6b2800-c50c-4b06-89b7-247b266f7627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6b2800-c50c-4b06-89b7-247b266f7627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b39d5dd-697f-4cbb-a916-b60d61edb580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b39d5dd-697f-4cbb-a916-b60d61edb580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5622a9f9-7b36-4622-9f6a-3add91485411', 'volume_name': 'volume-5622a9f9-7b36-4622-9f6a-3add91485411', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3528bb-742b-4f46-b68c-5eab4efcadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3528bb-742b-4f46-b68c-5eab4efcadfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e33181b-e4cd-49fa-861e-6657862aa61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume 5622a9f9-7b36-4622-9f6a-3add91485411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5622a9f9-7b36-4622-9f6a-3add91485411', 'volume_size': 1} Sep 28 15:22:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleted volume successfully. Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa93cad0-691f-4e2a-96a7-be04648b0489 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-6e43cdc3-039c-4c55-b857-e35cebaed1a2-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-d9243b63-6630-451e-91f8-f0e4aa2e8331-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-d9243b63-6630-451e-91f8-f0e4aa2e8331-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-d9243b63-6630-451e-91f8-f0e4aa2e8331" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-d9243b63-6630-451e-91f8-f0e4aa2e8331" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d340a5ae-38c7-4d96-b6ae-8b00f4c4fd74]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 Sep 28 15:22:57 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 1073741824" returned: 0 in 0.833s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 Sep 28 15:22:57 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331" returned: 0 in 0.636s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:57 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331 Sep 28 15:22:57 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:57 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88" returned: 0 in 0.456s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595181193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28191766-e0f5-4043-ba9a-8ac5745bf73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:56Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Creating volume 28191766-e0f5-4043-ba9a-8ac5745bf73f {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:58 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2549cb0-398f-4d70-a68b-9910bf70d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00173086-df5e-47a5-8d9a-de30b2665e88', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae0e4e8-9ded-454d-b0d8-9dd1d34c832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:58 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f 1073741824 Sep 28 15:22:58 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume volume-00173086-df5e-47a5-8d9a-de30b2665e88 (00173086-df5e-47a5-8d9a-de30b2665e88): created successfully Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae0e4e8-9ded-454d-b0d8-9dd1d34c832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (c0121feb-c879-4078-8d3c-9c532cb41b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-eec670fc-8f8b-49be-a284-0f4060a7d347 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created volume successfully. Sep 28 15:22:58 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-d9243b63-6630-451e-91f8-f0e4aa2e8331" returned: 0 in 0.385s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-d9243b63-6630-451e-91f8-f0e4aa2e8331" released by "delete_volume" :: held 1.090s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['eb63c33a-fb89-4970-9dcc-8682fe683388', '8177f70b-6760-4d1d-9779-5b1ee3bdb780', '95b10ee4-d217-434b-aa06-a5c85845b4e7', '4cb4556f-189a-43c6-810d-35035a30fc3a'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:22:58 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f 1073741824" returned: 0 in 0.721s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:58 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f Sep 28 15:22:58 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:58 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.326s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleted volume successfully. Sep 28 15:22:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bd8037dc-f03f-4c6c-b044-28dbaf607347 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-d9243b63-6630-451e-91f8-f0e4aa2e8331-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:59 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f" returned: 0 in 0.331s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.149s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926096907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5622a9f9-7b36-4622-9f6a-3add91485411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf37344029e46e9ae3c8fd51dfcd92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:57Z,use_quota=True,user_id='b04c29330139460c957ce07958a25bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Creating volume 5622a9f9-7b36-4622-9f6a-3add91485411 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:22:59 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edd99c6-5140-4f3d-a84a-3f04dcf08708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28191766-e0f5-4043-ba9a-8ac5745bf73f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:59 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 1073741824 Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f288678-4628-419b-96b1-ae06133501e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:59 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume volume-28191766-e0f5-4043-ba9a-8ac5745bf73f (28191766-e0f5-4043-ba9a-8ac5745bf73f): created successfully Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f288678-4628-419b-96b1-ae06133501e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (2e7745f6-45fc-4ac8-ab8d-78434a59a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1f76e4f2-5305-4830-bdcb-5cd19ab6d51b tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created volume successfully. Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-bff6e5cd-f2c9-40fc-b1d7-310b425853a3-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-bff6e5cd-f2c9-40fc-b1d7-310b425853a3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-bff6e5cd-f2c9-40fc-b1d7-310b425853a3" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-bff6e5cd-f2c9-40fc-b1d7-310b425853a3" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2828c-7b1a-40d1-8ef6-5394734e7c6b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 Sep 28 15:22:59 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 1073741824" returned: 0 in 0.633s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 Sep 28 15:22:59 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3" returned: 0 in 0.533s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3 Sep 28 15:23:00 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411" returned: 0 in 0.492s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e33181b-e4cd-49fa-861e-6657862aa61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5622a9f9-7b36-4622-9f6a-3add91485411', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3d166d-92a1-4f8a-aab5-88e7c3ec5b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Volume volume-5622a9f9-7b36-4622-9f6a-3add91485411 (5622a9f9-7b36-4622-9f6a-3add91485411): created successfully Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3d166d-92a1-4f8a-aab5-88e7c3ec5b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Flow 'volume_create_manager' (232446c5-9525-44d5-9178-cb4184854e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Flow 'volume_create_manager' (1c89fe1d-6444-4627-a426-6a00a0e87f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde6476e-be52-4e68-a23b-7c1caf6835ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-26f2def9-a029-40d3-9ce4-f0ea8cc3538f tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created volume successfully. Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde6476e-be52-4e68-a23b-7c1caf6835ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf2db61-715e-45aa-8784-f19be37f6076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a650ec6cc8db44a099be5305739bea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:00Z,use_quota=True,user_id='1fe7810acf214746bfdf9a2a74602943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463c4982-43e3-4eac-8051-360e708fe9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463c4982-43e3-4eac-8051-360e708fe9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec31c199-d15c-4793-974d-2f0ad0c80de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.image.glance [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Creating Keystone auth plugin from conf {{(pid=86888) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:23:00 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bff6e5cd-f2c9-40fc-b1d7-310b425853a3" returned: 0 in 0.447s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-bff6e5cd-f2c9-40fc-b1d7-310b425853a3" released by "delete_volume" :: held 1.060s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['d6d114bf-f781-4ee2-a28d-4434743397d8', 'b3e71763-92da-45c3-9630-123f17f95c0b', '1baea647-de0e-4ed7-a0db-a3b6973d56e3', 'c213cade-6200-4834-b86f-84bf4627369e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:00 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec31c199-d15c-4793-974d-2f0ad0c80de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bf2db61-715e-45aa-8784-f19be37f6076', 'volume_name': 'volume-5bf2db61-715e-45aa-8784-f19be37f6076', 'volume_size': 1, 'image_id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca0f3c5f71a2c6b4d28e2069386e6705', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a650ec6cc8db44a099be5305739bea87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75eb7fdd9528932a1b1b0d0577e2bbfb4afb04d42580a8f7d68788dc9089b884b6f4e8e6780ca3c5cef6a13bc4457eaeed762237f7745aa3a3f1c3bf8922f5b9', 'id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6/file', 'properties': {}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261619ff-2dd1-4bf7-873b-ef7f5706c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261619ff-2dd1-4bf7-873b-ef7f5706c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8ea51b-9350-4d97-babd-d033001b8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Volume 5bf2db61-715e-45aa-8784-f19be37f6076: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bf2db61-715e-45aa-8784-f19be37f6076', 'volume_size': 1, 'image_id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca0f3c5f71a2c6b4d28e2069386e6705', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a650ec6cc8db44a099be5305739bea87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75eb7fdd9528932a1b1b0d0577e2bbfb4afb04d42580a8f7d68788dc9089b884b6f4e8e6780ca3c5cef6a13bc4457eaeed762237f7745aa3a3f1c3bf8922f5b9', 'id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6/file', 'properties': {}}, 'image_service': } Sep 28 15:23:00 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Trying to clone 5bf2db61-715e-45aa-8784-f19be37f6076 from image b860368d-e157-4a64-a5cb-92c0a2bd54c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'metadata': {}}]). {{(pid=86888) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:23:01 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleted volume successfully. Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 28 15:23:01 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-de40a629-00d4-4275-a4a7-dfbb121f6b4d tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-bff6e5cd-f2c9-40fc-b1d7-310b425853a3-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab233f6-0a7a-443b-b504-27107cf0a7d9]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD Sep 28 15:23:01 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-5622a9f9-7b36-4622-9f6a-3add91485411-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-5622a9f9-7b36-4622-9f6a-3add91485411-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-quobyte-5622a9f9-7b36-4622-9f6a-3add91485411" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-5622a9f9-7b36-4622-9f6a-3add91485411" acquired by "delete_volume" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda0895-8414-4ee2-9681-ee61c565be1d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-d91147b3-d5e1-4e13-92c2-b98a4ebfca28-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-d91147b3-d5e1-4e13-92c2-b98a4ebfca28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-decbe929-42b2-41bd-b597-4faef2eb537a" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-decbe929-42b2-41bd-b597-4faef2eb537a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-d91147b3-d5e1-4e13-92c2-b98a4ebfca28" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:01 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD Sep 28 15:23:01 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-d91147b3-d5e1-4e13-92c2-b98a4ebfca28" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleting offline snapshot d91147b3-d5e1-4e13-92c2-b98a4ebfca28 of volume decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:01 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 Sep 28 15:23:01 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] snapshot_file for this snap is: volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[db161057-c743-4984-8f9d-f8454b9b76b6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 Sep 28 15:23:02 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Temporary image b860368d-e157-4a64-a5cb-92c0a2bd54c6 is fetched for user 1fe7810acf214746bfdf9a2a74602943. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c4a00-0785-4cf7-a7b8-f1b0c6ab79de]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411" returned: 0 in 0.588s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411 Sep 28 15:23:02 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD Sep 28 15:23:02 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28" returned: 0 in 0.547s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-decbe929-42b2-41bd-b597-4faef2eb537a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6604a8-2078-42ed-b36c-4c8bfcc74269]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5622a9f9-7b36-4622-9f6a-3add91485411" returned: 0 in 0.337s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-5622a9f9-7b36-4622-9f6a-3add91485411" released by "delete_volume" :: held 0.988s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:02 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a Sep 28 15:23:02 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created reservations ['b8663fc0-38a8-48d6-a1d7-6489a9419a97', 'fe4343e0-c653-4b62-a211-b7dea3b4f8c4', 'ebe928bd-0614-4ee4-aa6a-6a6be8200348', '95c3ed98-a359-4734-9712-d2141ef2cdab'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:02 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD Sep 28 15:23:02 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a" returned: 0 in 0.518s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:02 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:02 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 Sep 28 15:23:03 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD" returned: 1 in 0.472s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf2db61-715e-45aa-8784-f19be37f6076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a650ec6cc8db44a099be5305739bea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:00Z,use_quota=True,user_id='1fe7810acf214746bfdf9a2a74602943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Creating volume 5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:03 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 1073741824 Sep 28 15:23:03 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Deleted volume successfully. Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-50546013-02aa-42c3-bb20-1aa4502d908c tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-5622a9f9-7b36-4622-9f6a-3add91485411-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:03 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28 Sep 28 15:23:03 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 1073741824" returned: 0 in 0.481s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a.d91147b3-d5e1-4e13-92c2-b98a4ebfca28" returned: 0 in 0.319s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:03 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-d91147b3-d5e1-4e13-92c2-b98a4ebfca28" released by "_delete_snapshot" :: held 1.933s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-decbe929-42b2-41bd-b597-4faef2eb537a" released by "delete_snapshot" :: held 1.973s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['60cae9c8-9389-42b6-88d0-833de814593a', '11446966-2e9b-4a15-82b0-773862e16f22', '4f083098-9179-4d8b-bab5-63d18576425f', 'f897c1c0-11a8-41d2-ba3d-73cc64d80c03'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-28191766-e0f5-4043-ba9a-8ac5745bf73f-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-28191766-e0f5-4043-ba9a-8ac5745bf73f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Delete snapshot completed successfully. Sep 28 15:23:03 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-07ddf9b0-89f5-4c12-bcbd-ca3ae42ea900 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-d91147b3-d5e1-4e13-92c2-b98a4ebfca28-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-quobyte-28191766-e0f5-4043-ba9a-8ac5745bf73f" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-28191766-e0f5-4043-ba9a-8ac5745bf73f" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:04 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 0 in 0.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da310b7-f2c0-4ca6-85be-9daa369562b6]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Attempting download of b860368d-e157-4a64-a5cb-92c0a2bd54c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'metadata': {}}])) to volume 5bf2db61-715e-45aa-8784-f19be37f6076. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7976e02-35bd-41f2-b20a-251eba751cc0]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f Sep 28 15:23:04 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj Sep 28 15:23:04 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj" returned: 0 in 0.367s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f" returned: 0 in 0.489s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f Sep 28 15:23:04 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj Sep 28 15:23:04 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-28191766-e0f5-4043-ba9a-8ac5745bf73f" returned: 0 in 0.270s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-28191766-e0f5-4043-ba9a-8ac5745bf73f" released by "delete_volume" :: held 0.825s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:04 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj" returned: 1 in 0.385s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mtdwqqsj' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e988be1-5a20-4fb6-b228-f9799e266daf]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created reservations ['b828caa1-1ef9-4341-8edc-6f7de9bf7a7c', '2f263fa8-c13f-4748-a686-5961dfc88b92', '776ea049-3b0d-4fa1-b13e-443433cfdc82', 'c591a7e3-f139-4f40-99d4-a2b46b3eedc1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-decbe929-42b2-41bd-b597-4faef2eb537a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-decbe929-42b2-41bd-b597-4faef2eb537a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "cinder-quobyte-decbe929-42b2-41bd-b597-4faef2eb537a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD Sep 28 15:23:05 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-decbe929-42b2-41bd-b597-4faef2eb537a" acquired by "delete_volume" :: waited 0.061s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:05 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:05 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-00173086-df5e-47a5-8d9a-de30b2665e88-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7369c2-3628-453c-ad64-e091703690ca]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-00173086-df5e-47a5-8d9a-de30b2665e88-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-quobyte-00173086-df5e-47a5-8d9a-de30b2665e88" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-00173086-df5e-47a5-8d9a-de30b2665e88" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[03216173-d896-4970-b732-7a9df9ca4d2b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a Sep 28 15:23:05 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 Sep 28 15:23:05 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.383s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:05 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Deleted volume successfully. Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d0c66999-ce1e-4f49-9eae-5d3a6482b1fe tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-28191766-e0f5-4043-ba9a-8ac5745bf73f-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:05 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD Sep 28 15:23:05 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a" returned: 0 in 0.508s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a Sep 28 15:23:05 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88" returned: 0 in 0.438s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88 Sep 28 15:23:05 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:05 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] b860368d-e157-4a64-a5cb-92c0a2bd54c6 was raw, converting to raw {{(pid=86888) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 28 15:23:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:05 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:05 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-decbe929-42b2-41bd-b597-4faef2eb537a" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-quobyte-decbe929-42b2-41bd-b597-4faef2eb537a" released by "delete_volume" :: held 0.933s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:06 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-00173086-df5e-47a5-8d9a-de30b2665e88" returned: 0 in 0.311s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-00173086-df5e-47a5-8d9a-de30b2665e88" released by "delete_volume" :: held 0.806s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Created reservations ['795a2084-d63c-4832-bdc6-7cda096d03f3', 'b2aad5ec-7ea7-4e81-9f29-ca52459300dd', 'fc337001-bcec-43af-89de-c569072298aa', 'f09f7652-165c-4930-81f1-d94da7522d05'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created reservations ['8ade1a1e-07e6-4472-962a-9420f14906ea', '6848c657-9ab0-4072-8f44-de870cef5197', '444e25fd-31e4-49a3-a3b6-e613f27b1d30', 'e3a7197f-facd-487f-9d60-65dfa650a30d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:06 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 0 in 0.440s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b860368d-e157-4a64-a5cb-92c0a2bd54c6_mnmnlbg5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:23:06 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 1G Sep 28 15:23:06 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:06 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:06 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-5feec2fb-abe0-4b77-86aa-539acf99ebc9-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-5feec2fb-abe0-4b77-86aa-539acf99ebc9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-quobyte-5feec2fb-abe0-4b77-86aa-539acf99ebc9" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-5feec2fb-abe0-4b77-86aa-539acf99ebc9" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4cc98c-2444-4792-84ef-431427415472]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 1G" returned: 0 in 0.484s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 Sep 28 15:23:06 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:06 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.478s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15e30d-7d44-4f6c-83d0-e4b736aa9e25]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:06 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Deleted volume successfully. Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Deleted volume successfully. Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c0589871-bf31-42ac-a24e-5ec7452f5e88 tempest-CreateVolumesFromSnapshotTest-300019540 None] Lock "cinder-decbe929-42b2-41bd-b597-4faef2eb537a-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c41dcfc1-8e5c-4524-ab2a-8120300a7e2a tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-00173086-df5e-47a5-8d9a-de30b2665e88-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:06 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:06 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9" returned: 0 in 0.441s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9 Sep 28 15:23:07 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 0 in 0.461s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5feec2fb-abe0-4b77-86aa-539acf99ebc9" returned: 0 in 0.317s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-5feec2fb-abe0-4b77-86aa-539acf99ebc9" released by "delete_volume" :: held 0.823s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:07 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:07 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created reservations ['f831ea3d-6347-4ded-b17e-77b290b13e47', '0e6d63b8-a121-45f3-9bcc-15a63d2e7e96', 'b20f4a51-5601-4578-bc10-19ba729ad159', '1cc79679-0a74-4f3d-a0b1-091361ae5ad4'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:07 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:07 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-4f90911d-c26f-45d4-919b-a366610be2a7-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-4f90911d-c26f-45d4-919b-a366610be2a7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:07 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 1 in 0.640s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Downloaded image b860368d-e157-4a64-a5cb-92c0a2bd54c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'metadata': {}}])) to volume 5bf2db61-715e-45aa-8784-f19be37f6076 successfully. {{(pid=86888) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Temporary image b860368d-e157-4a64-a5cb-92c0a2bd54c6 for user 1fe7810acf214746bfdf9a2a74602943 is deleted. {{(pid=86888) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.volume.volume_utils [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Marking volume 5bf2db61-715e-45aa-8784-f19be37f6076 as bootable. {{(pid=86888) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-quobyte-4f90911d-c26f-45d4-919b-a366610be2a7" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Copying metadata from image b860368d-e157-4a64-a5cb-92c0a2bd54c6 to 5bf2db61-715e-45aa-8784-f19be37f6076. {{(pid=86888) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:23:07 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Creating volume glance metadata for volume 5bf2db61-715e-45aa-8784-f19be37f6076 backed by image b860368d-e157-4a64-a5cb-92c0a2bd54c6 with: {'image_id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ca0f3c5f71a2c6b4d28e2069386e6705', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86888) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-4f90911d-c26f-45d4-919b-a366610be2a7" acquired by "delete_volume" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5adf35f-a2dc-45f7-95a4-ebb9cc116715]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.444s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Deleted volume successfully. Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-eba9ce1b-da08-45f9-a773-c24fe9131cdd tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-5feec2fb-abe0-4b77-86aa-539acf99ebc9-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8ea51b-9350-4d97-babd-d033001b8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf2db61-715e-45aa-8784-f19be37f6076', 'volume_size': 1, 'image_id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca0f3c5f71a2c6b4d28e2069386e6705', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a650ec6cc8db44a099be5305739bea87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75eb7fdd9528932a1b1b0d0577e2bbfb4afb04d42580a8f7d68788dc9089b884b6f4e8e6780ca3c5cef6a13bc4457eaeed762237f7745aa3a3f1c3bf8922f5b9', 'id': 'b860368d-e157-4a64-a5cb-92c0a2bd54c6', 'created_at': datetime.datetime(2026, 9, 28, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b860368d-e157-4a64-a5cb-92c0a2bd54c6/file', 'properties': {}}, 'image_service': }' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e0c22-c56c-44ed-a150-871b7ec55199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:08 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 Sep 28 15:23:08 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Volume volume-5bf2db61-715e-45aa-8784-f19be37f6076 (5bf2db61-715e-45aa-8784-f19be37f6076): created successfully Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e0c22-c56c-44ed-a150-871b7ec55199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Flow 'volume_create_manager' (1c89fe1d-6444-4627-a426-6a00a0e87f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f28afb14-6b8e-4b80-9b57-64250b195f8b tempest-VolumeImageDependencyTests-276478566 None] Created volume successfully. Sep 28 15:23:08 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:08 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7 Sep 28 15:23:08 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-4f90911d-c26f-45d4-919b-a366610be2a7" returned: 0 in 0.347s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:08 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-4f90911d-c26f-45d4-919b-a366610be2a7" released by "delete_volume" :: held 0.888s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created reservations ['eb3aef2f-cdde-40bd-a6a9-e7a73312b8e7', '4bff194c-76e2-4c48-9440-dba6377ee336', 'af26282b-7de3-4684-9d2b-21235412afb7', '25fec22f-5d7c-4ce9-964f-26c5e126b502'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Acquiring lock "cinder-5bf2db61-715e-45aa-8784-f19be37f6076-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Lock "cinder-5bf2db61-715e-45aa-8784-f19be37f6076-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:09 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Acquiring lock "cinder-quobyte-5bf2db61-715e-45aa-8784-f19be37f6076" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Lock "cinder-quobyte-5bf2db61-715e-45aa-8784-f19be37f6076" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db609d7-701f-407d-9474-b8b4e100eda3]: (4, 'raw') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:09 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:09 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:09 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.394s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Deleted volume successfully. Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ff3a5770-6a40-4d96-858c-79369c293b00 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-4f90911d-c26f-45d4-919b-a366610be2a7-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:09 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 0 in 0.566s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:10 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-435cf406-501d-468f-8b57-8af5feb50c95-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-435cf406-501d-468f-8b57-8af5feb50c95-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "cinder-quobyte-435cf406-501d-468f-8b57-8af5feb50c95" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-435cf406-501d-468f-8b57-8af5feb50c95" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b324b-c76b-41e1-a673-3a9bc8506e1d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 1 in 0.448s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076' failed. Not Retrying. {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076 Sep 28 15:23:10 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 Sep 28 15:23:10 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5bf2db61-715e-45aa-8784-f19be37f6076" returned: 0 in 0.337s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Lock "cinder-quobyte-5bf2db61-715e-45aa-8784-f19be37f6076" released by "delete_volume" :: held 1.453s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:10 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95" returned: 0 in 0.471s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:10 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95 Sep 28 15:23:10 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Created reservations ['5522f22c-078e-48be-8093-bd17a0cb8aaf', 'd012afcb-a8fa-450f-b3ca-a187e5f3e554', '8244544e-eec2-4604-b397-3aef18f89b0c', '271f0c08-9743-4664-9da7-497b4492d34d'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:11 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-435cf406-501d-468f-8b57-8af5feb50c95" returned: 0 in 0.350s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-quobyte-435cf406-501d-468f-8b57-8af5feb50c95" released by "delete_volume" :: held 0.896s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Created reservations ['71cb2515-16c8-4a36-a50e-00c9dd6970b5', '39200542-696b-4f18-aa6e-c9a0c9d5de69', 'b98ca817-5baf-4545-83fc-e810228a11ff', '2e18b8ee-7aa6-4d16-85b5-fb9d3fd93fb1'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:11 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.425s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Deleted volume successfully. Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:11 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:11 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5c85c3e1-a4fb-4413-a040-d4a0824b38ad tempest-VolumeImageDependencyTests-276478566 None] Lock "cinder-5bf2db61-715e-45aa-8784-f19be37f6076-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:11 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.338s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Deleted volume successfully. Sep 28 15:23:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9fd63d06-d066-4942-8cf7-cd75b2cb8001 tempest-CreateVolumesFromSourceVolumeTest-2140385665 None] Lock "cinder-435cf406-501d-468f-8b57-8af5feb50c95-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (fe6fad15-33e6-4303-a9ce-c9a436bdf3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299c45ba-e803-428d-9b2f-05d2effcba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299c45ba-e803-428d-9b2f-05d2effcba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471238738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6497ae-182f-4ba6-bc40-c35b86416d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:13Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36a7643-3374-4658-9da3-c4e4675be67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36a7643-3374-4658-9da3-c4e4675be67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff052fc-2968-4796-a811-442cf1c8d012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff052fc-2968-4796-a811-442cf1c8d012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6497ae-182f-4ba6-bc40-c35b86416d22', 'volume_name': 'volume-1d6497ae-182f-4ba6-bc40-c35b86416d22', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c3469-602f-4904-85b1-ebb513137299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c3469-602f-4904-85b1-ebb513137299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45eab443-a377-4d1c-8f68-d32934d217d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Volume 1d6497ae-182f-4ba6-bc40-c35b86416d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6497ae-182f-4ba6-bc40-c35b86416d22', 'volume_size': 1} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471238738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6497ae-182f-4ba6-bc40-c35b86416d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:13Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Creating volume 1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:13 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 1073741824 Sep 28 15:23:13 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 1073741824" returned: 0 in 0.653s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 Sep 28 15:23:13 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22" returned: 0 in 0.461s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45eab443-a377-4d1c-8f68-d32934d217d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6497ae-182f-4ba6-bc40-c35b86416d22', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460fb2ae-c02d-4b52-9472-28af2fd1eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Volume volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 (1d6497ae-182f-4ba6-bc40-c35b86416d22): created successfully Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460fb2ae-c02d-4b52-9472-28af2fd1eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (fe6fad15-33e6-4303-a9ce-c9a436bdf3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8507275e-93b9-4923-bb41-5191aaf5559e tempest-ProjectReaderTests-994541763 None] Created volume successfully. Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Creating offline snapshot f9721005-5f79-4f0a-a40f-85b4bb7496c1 of volume 1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa1d84-fe1d-416b-9cb0-2ee30379a01b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 Sep 28 15:23:15 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:15 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22" returned: 0 in 0.430s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:15 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 1G Sep 28 15:23:15 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:16 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Flow 'volume_create_manager' (19cc15ec-7705-43c9-b160-53db6a88d2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dde7ab0-adec-4e00-9401-a8dcafcf25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 1G" returned: 0 in 0.673s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dde7ab0-adec-4e00-9401-a8dcafcf25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-33697374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df02acb-b056-4ba9-aba7-a0902567ca85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7eca4873a54260b11b7adc7191f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:16Z,use_quota=True,user_id='11d2c0e143544be5a7039c327b999038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f84e20d-4a27-4754-aee9-4909fa2b4233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f84e20d-4a27-4754-aee9-4909fa2b4233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bbf21f-3769-4482-843f-8439e377d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bbf21f-3769-4482-843f-8439e377d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df02acb-b056-4ba9-aba7-a0902567ca85', 'volume_name': 'volume-5df02acb-b056-4ba9-aba7-a0902567ca85', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7502bab2-aeec-4eb1-813a-dd4731bd0cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7502bab2-aeec-4eb1-813a-dd4731bd0cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b754ed10-b391-43c5-92fb-ae2f2ba416ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:16 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Volume 5df02acb-b056-4ba9-aba7-a0902567ca85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df02acb-b056-4ba9-aba7-a0902567ca85', 'volume_size': 1} Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:16 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1" returned: 0 in 0.388s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:16 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 is being set with open permissions: ugo+rw Sep 28 15:23:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 Sep 28 15:23:16 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info Sep 28 15:23:17 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info" returned: 0 in 0.348s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info is being set with open permissions: ugo+rw Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info Sep 28 15:23:17 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.info" returned: 0 in 0.247s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-33697374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df02acb-b056-4ba9-aba7-a0902567ca85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7eca4873a54260b11b7adc7191f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:16Z,use_quota=True,user_id='11d2c0e143544be5a7039c327b999038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Creating volume 5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:17 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 1073741824 Sep 28 15:23:17 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8654fff4-019e-4812-bd5a-0981d7a600af tempest-ProjectReaderTests-994541763 None] Create snapshot completed successfully Sep 28 15:23:18 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 1073741824" returned: 0 in 0.531s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:18 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-f9721005-5f79-4f0a-a40f-85b4bb7496c1-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Lock "cinder-f9721005-5f79-4f0a-a40f-85b4bb7496c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-1d6497ae-182f-4ba6-bc40-c35b86416d22" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-1d6497ae-182f-4ba6-bc40-c35b86416d22" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-f9721005-5f79-4f0a-a40f-85b4bb7496c1" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:18 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-f9721005-5f79-4f0a-a40f-85b4bb7496c1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Deleting offline snapshot f9721005-5f79-4f0a-a40f-85b4bb7496c1 of volume 1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] snapshot_file for this snap is: volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b754ed10-b391-43c5-92fb-ae2f2ba416ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df02acb-b056-4ba9-aba7-a0902567ca85', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:18 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f624835-78b9-4a76-9413-a5f6242cc2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7effd332-034e-4257-96c3-9c6ee38bb197]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Volume volume-5df02acb-b056-4ba9-aba7-a0902567ca85 (5df02acb-b056-4ba9-aba7-a0902567ca85): created successfully Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f624835-78b9-4a76-9413-a5f6242cc2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Flow 'volume_create_manager' (19cc15ec-7705-43c9-b160-53db6a88d2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:19 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ce3ee050-6e43-485c-8039-e07863a5cda3 tempest-VolumeDependencyTests-566517528 None] Created volume successfully. Sep 28 15:23:19 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 Sep 28 15:23:19 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1" returned: 0 in 0.507s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d6497ae-182f-4ba6-bc40-c35b86416d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e247a4a6-bf62-4727-a13e-2d5543f75daf]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 Sep 28 15:23:19 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Creating offline snapshot 9371f21b-457b-4286-b7ff-273011702fe3 of volume 5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[384fa3a2-cc28-44b2-8472-e64d1ea58c04]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22" returned: 0 in 0.536s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 Sep 28 15:23:20 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:20 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.509s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 1G Sep 28 15:23:20 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:20 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1" returned: 0 in 0.529s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:20 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1 Sep 28 15:23:20 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22.f9721005-5f79-4f0a-a40f-85b4bb7496c1" returned: 0 in 0.478s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 1G" returned: 0 in 0.620s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df02acb-b056-4ba9-aba7-a0902567ca85 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-f9721005-5f79-4f0a-a40f-85b4bb7496c1" released by "_delete_snapshot" :: held 2.239s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-1d6497ae-182f-4ba6-bc40-c35b86416d22" released by "delete_snapshot" :: held 2.289s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df02acb-b056-4ba9-aba7-a0902567ca85 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 Sep 28 15:23:21 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=261,cinder:SELECT=180,cinder:DELETE=26,cinder:INSERT=68 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=194,cinder:INSERT=70,cinder:UPDATE=252,cinder:DELETE=21 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Created reservations ['2bd74c55-f638-42d3-b170-294d28c10e0e', '0923d713-dd0c-4505-9934-dbe9479890b7', 'd3971ac8-7db5-4efa-9967-d37f6921ae52', '8af5085a-bedc-40f9-bfac-4c4e30f31481'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:21 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Delete snapshot completed successfully. Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-d893210d-f600-45be-a9a6-3b179a367cbf tempest-ProjectReaderTests-994541763 None] Lock "cinder-f9721005-5f79-4f0a-a40f-85b4bb7496c1-delete_snapshot" released by "delete_snapshot" :: held 2.564s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df02acb-b056-4ba9-aba7-a0902567ca85 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3" returned: 0 in 0.440s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 is being set with open permissions: ugo+rw Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 Sep 28 15:23:21 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3" returned: 0 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info Sep 28 15:23:22 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-1d6497ae-182f-4ba6-bc40-c35b86416d22-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Lock "cinder-1d6497ae-182f-4ba6-bc40-c35b86416d22-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-1d6497ae-182f-4ba6-bc40-c35b86416d22" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-1d6497ae-182f-4ba6-bc40-c35b86416d22" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4958cc-1100-4d7a-8fab-28de513d75da]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info" returned: 0 in 0.425s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:22 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info is being set with open permissions: ugo+rw Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info Sep 28 15:23:22 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 Sep 28 15:23:22 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:22 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.info" returned: 0 in 0.335s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:22 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22" returned: 0 in 0.500s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:22 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-329b876b-ff71-4090-bba3-851bcbba2e10 tempest-VolumeDependencyTests-566517528 None] Create snapshot completed successfully Sep 28 15:23:22 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22 Sep 28 15:23:22 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1d6497ae-182f-4ba6-bc40-c35b86416d22" returned: 0 in 0.440s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-1d6497ae-182f-4ba6-bc40-c35b86416d22" released by "delete_volume" :: held 1.049s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (eefa2173-f765-43bb-bfd4-3939ae2ba551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9de5011-ea4f-437a-a34c-5c2f7f730757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9de5011-ea4f-437a-a34c-5c2f7f730757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136725132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ab1070-8806-48a5-ad46-643c35486a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:23Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322247c3-99b6-4259-9186-d68ccf805807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322247c3-99b6-4259-9186-d68ccf805807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c159096-8253-4388-95b3-2bdbd61aaa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c159096-8253-4388-95b3-2bdbd61aaa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ab1070-8806-48a5-ad46-643c35486a0e', 'volume_name': 'volume-96ab1070-8806-48a5-ad46-643c35486a0e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e76c65-2ad2-42ba-81e0-7600a2870421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e76c65-2ad2-42ba-81e0-7600a2870421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caea965a-04c3-41ac-89fe-b450f9b9c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:23 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Volume 96ab1070-8806-48a5-ad46-643c35486a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ab1070-8806-48a5-ad46-643c35486a0e', 'volume_size': 1} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136725132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ab1070-8806-48a5-ad46-643c35486a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:23Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Creating volume 96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:23 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e 1073741824 Sep 28 15:23:23 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Created reservations ['620d90d9-2c74-41f2-b281-942281e5a5e4', 'fc6bf91f-d179-496c-9aaa-2f84baee696c', 'd14f066c-3c48-4850-8558-878ec2083388', '4253cf37-be55-47c3-9a07-2efd4bca5e96'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:23 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:23 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.439s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Deleted volume successfully. Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6959f3f1-db4c-43a9-b89e-a037b06b3a6b tempest-ProjectReaderTests-994541763 None] Lock "cinder-1d6497ae-182f-4ba6-bc40-c35b86416d22-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Flow 'volume_create_manager' (8d65e35c-12b0-498b-aecc-17d0f14d61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaf7074-64a3-4eb4-a2fa-4aeba7c64a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e 1073741824" returned: 0 in 0.755s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaf7074-64a3-4eb4-a2fa-4aeba7c64a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540195918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dae68fa-d45f-4856-813e-e2e4600b324a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7eca4873a54260b11b7adc7191f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9371f21b-457b-4286-b7ff-273011702fe3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:24Z,use_quota=True,user_id='11d2c0e143544be5a7039c327b999038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbfce39-76ac-4442-9b77-284b55cfb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbfce39-76ac-4442-9b77-284b55cfb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6577fc2e-d9f0-403a-86f0-89659c5d9f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6577fc2e-d9f0-403a-86f0-89659c5d9f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1dae68fa-d45f-4856-813e-e2e4600b324a', 'volume_name': 'volume-1dae68fa-d45f-4856-813e-e2e4600b324a', 'volume_size': 1, 'snapshot_id': '9371f21b-457b-4286-b7ff-273011702fe3'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a486b7a2-e13e-4ca8-b9ed-b2d2c86a346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a486b7a2-e13e-4ca8-b9ed-b2d2c86a346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff55d607-ddbc-4af5-9cd7-043cd4b2dd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Volume 1dae68fa-d45f-4856-813e-e2e4600b324a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1dae68fa-d45f-4856-813e-e2e4600b324a', 'volume_size': 1, 'snapshot_id': '9371f21b-457b-4286-b7ff-273011702fe3'} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:24 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e Sep 28 15:23:24 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:24 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e" returned: 0 in 0.297s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.339s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-quobyte-9371f21b-457b-4286-b7ff-273011702fe3-1dae68fa-d45f-4856-813e-e2e4600b324a" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caea965a-04c3-41ac-89fe-b450f9b9c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ab1070-8806-48a5-ad46-643c35486a0e', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abd0537-f1d3-485b-a81a-d9ec1c54b8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-9371f21b-457b-4286-b7ff-273011702fe3-1dae68fa-d45f-4856-813e-e2e4600b324a" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Creating volume 1dae68fa-d45f-4856-813e-e2e4600b324a from snapshot 9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-quobyte-1dae68fa-d45f-4856-813e-e2e4600b324a" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:24 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Volume volume-96ab1070-8806-48a5-ad46-643c35486a0e (96ab1070-8806-48a5-ad46-643c35486a0e): created successfully Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abd0537-f1d3-485b-a81a-d9ec1c54b8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (eefa2173-f765-43bb-bfd4-3939ae2ba551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-1dae68fa-d45f-4856-813e-e2e4600b324a" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] snapshot: 9371f21b-457b-4286-b7ff-273011702fe3, volume: 1dae68fa-d45f-4856-813e-e2e4600b324a, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:23:24 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ea16312a-318d-4c6f-ae94-fd71c99273ee tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ba0c1-6c64-48f5-8039-1a9169211d22]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:24 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:25 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 Sep 28 15:23:25 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (60c357b2-9947-4982-be25-8998309d5f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acef9c60-3e8c-42bc-b748-8a758e8edd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acef9c60-3e8c-42bc-b748-8a758e8edd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508575007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3a298-abb2-4c16-907b-8c4ecf7afe02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:25Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4b3f62-1f14-4157-a0fb-160d3663b5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4b3f62-1f14-4157-a0fb-160d3663b5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e43c6a-4692-4d61-aa58-6b605879d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e43c6a-4692-4d61-aa58-6b605879d497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc3a298-abb2-4c16-907b-8c4ecf7afe02', 'volume_name': 'volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64377c3b-c226-46bc-81d9-860060c132c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64377c3b-c226-46bc-81d9-860060c132c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d8f03b-ad64-4bf0-8c4d-6edc2b515b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:25 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Volume 3cc3a298-abb2-4c16-907b-8c4ecf7afe02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02', 'volume_size': 1} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:25 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3" returned: 0 in 0.444s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df02acb-b056-4ba9-aba7-a0902567ca85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e0c88-933f-4e4e-a237-343f0f8c820a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:25 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:25 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:25 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.456s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:23:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:25 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a Sep 28 15:23:25 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a" returned: 0 in 7.350s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a9fba1-0a31-4c08-b789-011b990f7af9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:33 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.543s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:23:33 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Converted 1024.00 MB image at 139.29 MB/s Sep 28 15:23:33 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a is being set with open permissions: ugo+rw Sep 28 15:23:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a Sep 28 15:23:33 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a" returned: 0 in 0.286s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-1dae68fa-d45f-4856-813e-e2e4600b324a" released by "_copy_volume_from_snapshot" :: held 9.258s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-9371f21b-457b-4286-b7ff-273011702fe3-1dae68fa-d45f-4856-813e-e2e4600b324a" released by "_create_volume_from_snapshot" :: held 9.327s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.376s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.914s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508575007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3a298-abb2-4c16-907b-8c4ecf7afe02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:25Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Creating volume 3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:34 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 1073741824 Sep 28 15:23:34 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff55d607-ddbc-4af5-9cd7-043cd4b2dd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dae68fa-d45f-4856-813e-e2e4600b324a', 'volume_size': 1, 'snapshot_id': '9371f21b-457b-4286-b7ff-273011702fe3'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2685fe-d127-47da-a501-5403828f6338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Volume volume-1dae68fa-d45f-4856-813e-e2e4600b324a (1dae68fa-d45f-4856-813e-e2e4600b324a): created successfully Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2685fe-d127-47da-a501-5403828f6338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Flow 'volume_create_manager' (8d65e35c-12b0-498b-aecc-17d0f14d61bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:34 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9d6408e0-36ca-480a-b798-79e63190e41b tempest-VolumeDependencyTests-566517528 None] Created volume successfully. Sep 28 15:23:34 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 1073741824" returned: 0 in 0.479s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 Sep 28 15:23:34 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:34 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" returned: 0 in 0.284s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.095s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d8f03b-ad64-4bf0-8c4d-6edc2b515b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471b4e08-9437-4cff-bed7-ae37528433c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 65dec6b2-c911-464d-a6e3-11cbf1759ff9 of volume 96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:34 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Volume volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 (3cc3a298-abb2-4c16-907b-8c4ecf7afe02): created successfully Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471b4e08-9437-4cff-bed7-ae37528433c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (60c357b2-9947-4982-be25-8998309d5f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0f37e6-071d-464b-a3f4-61cf2f3f6431]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c8dae54b-a654-4e33-a6c2-7d70e2b27c7f tempest-ProjectReaderTests-994541763 None] Created volume successfully. Sep 28 15:23:35 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e Sep 28 15:23:35 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-9371f21b-457b-4286-b7ff-273011702fe3-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-9371f21b-457b-4286-b7ff-273011702fe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-quobyte-5df02acb-b056-4ba9-aba7-a0902567ca85" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-5df02acb-b056-4ba9-aba7-a0902567ca85" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-quobyte-9371f21b-457b-4286-b7ff-273011702fe3" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-9371f21b-457b-4286-b7ff-273011702fe3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Deleting offline snapshot 9371f21b-457b-4286-b7ff-273011702fe3 of volume 5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] snapshot_file for this snap is: volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9384c21-35b1-4887-bb1f-21e34ea4cde8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 Sep 28 15:23:35 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e" returned: 0 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 1G Sep 28 15:23:35 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3" returned: 0 in 0.490s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df02acb-b056-4ba9-aba7-a0902567ca85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7461ac-51d2-48c5-a430-088244c2f093]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 1G" returned: 0 in 0.482s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ab1070-8806-48a5-ad46-643c35486a0e -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:35 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ab1070-8806-48a5-ad46-643c35486a0e -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 Sep 28 15:23:35 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ab1070-8806-48a5-ad46-643c35486a0e -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9" returned: 0 in 0.407s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 is being set with open permissions: ugo+rw Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 Sep 28 15:23:36 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.603s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:36 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 Sep 28 15:23:36 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9" returned: 0 in 0.387s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info Sep 28 15:23:36 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3" returned: 0 in 0.451s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3 Sep 28 15:23:36 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info" returned: 0 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info is being set with open permissions: ugo+rw Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info Sep 28 15:23:37 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85.9371f21b-457b-4286-b7ff-273011702fe3" returned: 0 in 0.331s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-9371f21b-457b-4286-b7ff-273011702fe3" released by "_delete_snapshot" :: held 2.023s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-5df02acb-b056-4ba9-aba7-a0902567ca85" released by "delete_snapshot" :: held 2.053s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Created reservations ['77bad9b6-19c8-4fe7-8f1b-ddef69ba1df7', '139cd259-13a6-40cb-ab76-b33e48f87329', '091a5156-470c-4c2f-8a1b-0ac5f849b6a8', '9fad65f1-7dfb-4619-b453-d5d7b3930e2c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Delete snapshot completed successfully. Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b56e84b5-69de-4e1e-8662-fe366af62b2b tempest-VolumeDependencyTests-566517528 None] Lock "cinder-9371f21b-457b-4286-b7ff-273011702fe3-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.info" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.079s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:37 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-cb9bee80-13c9-4262-8ae2-d97a8906289c tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Creating offline snapshot 2a04647b-2b54-429c-9eaf-defdd3f126d9 of volume 3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e01e12-5641-4e4c-9cc4-e4b4eaed25a9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 Sep 28 15:23:37 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" returned: 0 in 0.439s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 1G Sep 28 15:23:38 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-5df02acb-b056-4ba9-aba7-a0902567ca85-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-5df02acb-b056-4ba9-aba7-a0902567ca85-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-quobyte-5df02acb-b056-4ba9-aba7-a0902567ca85" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-5df02acb-b056-4ba9-aba7-a0902567ca85" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:38 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 1G" returned: 0 in 0.543s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[67359bc8-4ec2-4a88-bb05-4bbacb8f2e13]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 Sep 28 15:23:38 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-65dec6b2-c911-464d-a6e3-11cbf1759ff9-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-65dec6b2-c911-464d-a6e3-11cbf1759ff9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-96ab1070-8806-48a5-ad46-643c35486a0e" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-96ab1070-8806-48a5-ad46-643c35486a0e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-65dec6b2-c911-464d-a6e3-11cbf1759ff9" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-65dec6b2-c911-464d-a6e3-11cbf1759ff9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 65dec6b2-c911-464d-a6e3-11cbf1759ff9 of volume 96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:38 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:38 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce6aff1-953f-4f29-8a64-7d9ea6b41d1d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9" returned: 0 in 0.407s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 Sep 28 15:23:38 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 is being set with open permissions: ugo+rw Sep 28 15:23:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 Sep 28 15:23:39 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.561s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85 Sep 28 15:23:39 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9" returned: 0 in 0.554s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96ab1070-8806-48a5-ad46-643c35486a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:39 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9" returned: 0 in 0.411s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e409413-2ebc-414a-92ac-67947f55c0aa]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-5df02acb-b056-4ba9-aba7-a0902567ca85" returned: 0 in 0.361s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info Sep 28 15:23:39 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-5df02acb-b056-4ba9-aba7-a0902567ca85" released by "delete_volume" :: held 1.033s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:39 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e Sep 28 15:23:39 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Created reservations ['9f3fed28-5921-4f24-a95e-b029a4af3342', '82f413c2-92c1-44c9-a5a7-043ae4de6eab', '9c5fc91a-8313-4e27-8b97-9e0648d8be65', '71b7bcd3-8ea3-4917-8562-6cc6e6323d5c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:39 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info" returned: 0 in 0.431s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info is being set with open permissions: ugo+rw Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info Sep 28 15:23:39 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e" returned: 0 in 0.586s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 Sep 28 15:23:40 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:40 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Deleted volume successfully. Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0fb7c32a-6825-4cd2-8c71-b6e6e022fb93 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-5df02acb-b056-4ba9-aba7-a0902567ca85-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:40 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.info" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:40 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-d133ff14-d115-49f0-b9b2-2247657f7d70 tempest-ProjectReaderTests-994541763 None] Create snapshot completed successfully Sep 28 15:23:40 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9" returned: 0 in 0.477s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9 Sep 28 15:23:40 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-2a04647b-2b54-429c-9eaf-defdd3f126d9-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Lock "cinder-2a04647b-2b54-429c-9eaf-defdd3f126d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:40 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:40 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-2a04647b-2b54-429c-9eaf-defdd3f126d9" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-1dae68fa-d45f-4856-813e-e2e4600b324a-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-2a04647b-2b54-429c-9eaf-defdd3f126d9" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Deleting offline snapshot 2a04647b-2b54-429c-9eaf-defdd3f126d9 of volume 3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] snapshot_file for this snap is: volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-1dae68fa-d45f-4856-813e-e2e4600b324a-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f57766-31a2-40eb-9cfe-5776c25f79f8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e.65dec6b2-c911-464d-a6e3-11cbf1759ff9" returned: 0 in 0.531s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "cinder-quobyte-1dae68fa-d45f-4856-813e-e2e4600b324a" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-65dec6b2-c911-464d-a6e3-11cbf1759ff9" released by "_delete_snapshot" :: held 2.378s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-96ab1070-8806-48a5-ad46-643c35486a0e" released by "delete_snapshot" :: held 2.420s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:41 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 Sep 28 15:23:41 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-1dae68fa-d45f-4856-813e-e2e4600b324a" acquired by "delete_volume" :: waited 0.066s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:41 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822b353-2378-4039-8956-4f88d8b45b80]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.604s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Created reservations ['aafd96d0-14c3-4f3d-89f9-0f61d2f8cb31', '0ad61ce1-b6c9-4c33-a383-51b2006ded92', 'ab9b7e9a-4807-483a-bf04-6917eac58c56', '518a752d-ce9d-49e4-bac6-804cc7974b14'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:41 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a Sep 28 15:23:41 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-037bd3a0-df32-40f8-b4d0-abd80f59c095 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-65dec6b2-c911-464d-a6e3-11cbf1759ff9-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:41 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9" returned: 0 in 0.579s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1435c265-8955-4b52-96d1-60da36a975d5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 Sep 28 15:23:41 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a" returned: 0 in 0.496s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a Sep 28 15:23:41 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-96ab1070-8806-48a5-ad46-643c35486a0e-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-96ab1070-8806-48a5-ad46-643c35486a0e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:42 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-1dae68fa-d45f-4856-813e-e2e4600b324a" returned: 0 in 0.385s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-96ab1070-8806-48a5-ad46-643c35486a0e" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:42 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 Sep 28 15:23:42 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-quobyte-1dae68fa-d45f-4856-813e-e2e4600b324a" released by "delete_volume" :: held 0.974s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-96ab1070-8806-48a5-ad46-643c35486a0e" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1ad3a8-00ab-4a13-9583-44cfbab9940d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Created reservations ['91300672-3108-48f9-9438-852d97c80e74', 'bba8b2dd-d28b-42ef-a859-ec2c2da28875', '374d5191-bf53-4da2-b8ea-50786de6da22', '656ace99-f579-4bf9-9630-461af9619a98'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:42 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e Sep 28 15:23:42 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:42 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9" returned: 0 in 0.511s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9 Sep 28 15:23:42 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.496s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:42 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Deleted volume successfully. Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-02c0842d-f7a8-4f64-9178-cd8d53697c39 tempest-VolumeDependencyTests-566517528 None] Lock "cinder-1dae68fa-d45f-4856-813e-e2e4600b324a-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:43 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e" returned: 0 in 0.855s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e Sep 28 15:23:43 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:43 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02.2a04647b-2b54-429c-9eaf-defdd3f126d9" returned: 0 in 0.676s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-2a04647b-2b54-429c-9eaf-defdd3f126d9" released by "_delete_snapshot" :: held 2.553s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" released by "delete_snapshot" :: held 2.611s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Created reservations ['58b355e2-d1a2-4433-a1c4-943f2a177e12', 'bcd4d8ea-eb63-4e2e-9da1-f02e8944cc24', 'df8a174b-1230-404f-831e-eaaef567d538', '8095b04f-5239-4563-948e-877a200534fd'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Delete snapshot completed successfully. Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-7c157720-0ffa-4089-844d-d41ab9c3e1c0 tempest-ProjectReaderTests-994541763 None] Lock "cinder-2a04647b-2b54-429c-9eaf-defdd3f126d9-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:43 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-96ab1070-8806-48a5-ad46-643c35486a0e" returned: 0 in 0.544s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-96ab1070-8806-48a5-ad46-643c35486a0e" released by "delete_volume" :: held 1.499s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Created reservations ['d5197e3d-2a57-420f-a1b6-c208db610eb3', 'ebb441a1-c61c-4291-9ed7-3a262efce327', 'd0211a46-eb60-42b3-9ead-dcdfff19776e', 'e1eb85e0-8188-454b-b405-896f9432e092'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:43 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:43 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-3cc3a298-abb2-4c16-907b-8c4ecf7afe02-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Lock "cinder-3cc3a298-abb2-4c16-907b-8c4ecf7afe02-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d64a2-f9b0-448b-b9c4-9dd956576431]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:44 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.529s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:23:44 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 Sep 28 15:23:44 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-032530cd-2d53-4c87-8131-d7cae13fc515 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-96ab1070-8806-48a5-ad46-643c35486a0e-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:44 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" returned: 0 in 0.596s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:44 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02 Sep 28 15:23:44 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (185ec9c1-14de-481b-8c02-c379e499b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9e4f54-d376-4ec0-9b41-f996354f4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9e4f54-d376-4ec0-9b41-f996354f4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879549452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a5c1a3-4ee1-4d2d-9877-70d14cfbd015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:45Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61069b57-1adf-4656-99ec-ef8a603632d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61069b57-1adf-4656-99ec-ef8a603632d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dca79b-99be-4a5a-a489-5aa7a70053af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:45 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dca79b-99be-4a5a-a489-5aa7a70053af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a5c1a3-4ee1-4d2d-9877-70d14cfbd015', 'volume_name': 'volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefea008-b18b-453d-9cbc-92838ce936d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefea008-b18b-453d-9cbc-92838ce936d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5637615-358f-422d-ac15-788e9451e2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:45 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Volume 88a5c1a3-4ee1-4d2d-9877-70d14cfbd015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015', 'volume_size': 1} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879549452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a5c1a3-4ee1-4d2d-9877-70d14cfbd015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:45Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Creating volume 88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:45 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" returned: 0 in 0.638s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:45 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 1073741824 Sep 28 15:23:45 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-3cc3a298-abb2-4c16-907b-8c4ecf7afe02" released by "delete_volume" :: held 1.365s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Created reservations ['b8799eb6-da0a-4317-b04c-811b85341298', 'd296fd66-8d78-4383-889d-353bcaf60bcb', '3e5e5bff-3215-4a66-8053-fbfc748272b8', '17932169-8ea0-4741-bd08-4fc1c11ffcba'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:45 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:45 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.406s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Deleted volume successfully. Sep 28 15:23:46 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 1073741824" returned: 0 in 0.800s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-8cd9f587-463b-4cbf-80ae-72eac1d775ea tempest-ProjectReaderTests-994541763 None] Lock "cinder-3cc3a298-abb2-4c16-907b-8c4ecf7afe02-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:46 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 Sep 28 15:23:46 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:46 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" returned: 0 in 0.499s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5637615-358f-422d-ac15-788e9451e2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cc54bd-3a22-44a5-844a-8912bf290549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:46 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Volume volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 (88a5c1a3-4ee1-4d2d-9877-70d14cfbd015): created successfully Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cc54bd-3a22-44a5-844a-8912bf290549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:46 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (185ec9c1-14de-481b-8c02-c379e499b30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:46 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f843bbfd-a33d-458b-aec3-5b80fd0c963f tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (c0969d79-941b-4976-b10f-869735d7e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13ae401-3b73-490d-ac6f-1e9186525632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13ae401-3b73-490d-ac6f-1e9186525632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323402846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb2f9cb-0ee6-448b-8485-b07ed9a96889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:47Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7322c51b-92f6-48c3-934c-26e2ba66135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7322c51b-92f6-48c3-934c-26e2ba66135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d536c2b-f3c2-4b98-9315-b979eecf9f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d536c2b-f3c2-4b98-9315-b979eecf9f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb2f9cb-0ee6-448b-8485-b07ed9a96889', 'volume_name': 'volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62eae6d7-a71d-4378-8361-210acae3c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62eae6d7-a71d-4378-8361-210acae3c48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d3d919-86a8-470a-a075-80f8322e6148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Volume 9fb2f9cb-0ee6-448b-8485-b07ed9a96889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889', 'volume_size': 1} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323402846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb2f9cb-0ee6-448b-8485-b07ed9a96889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:47Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Creating volume 9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:47 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 1073741824 Sep 28 15:23:47 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:48 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 1073741824" returned: 0 in 0.666s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 Sep 28 15:23:48 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:48 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" returned: 0 in 0.364s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.911s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d3d919-86a8-470a-a075-80f8322e6148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bff80fe-6fba-4d17-aec3-5b1d13fbcf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 of volume 88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Volume volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 (9fb2f9cb-0ee6-448b-8485-b07ed9a96889): created successfully Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bff80fe-6fba-4d17-aec3-5b1d13fbcf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (c0969d79-941b-4976-b10f-869735d7e77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e257589f-75fd-4d71-92b8-0a4b71578407]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1e6e7b2a-e25a-404e-8c55-bf6be192b98a tempest-ProjectReaderTests-994541763 None] Created volume successfully. Sep 28 15:23:48 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 Sep 28 15:23:48 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1672e575-da13-4f95-8289-c879255c1773 tempest-ProjectAdminTests-2140381318 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2040061950684, 'free_capacity_gb': 1775.2040061950684, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86888) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:23:49 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" returned: 0 in 0.655s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 1G Sep 28 15:23:49 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:50 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 1G" returned: 0 in 0.853s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:50 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 Sep 28 15:23:50 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 is being set with open permissions: ugo+rw Sep 28 15:23:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:50 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 Sep 28 15:23:50 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" returned: 0 in 0.477s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info Sep 28 15:23:51 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info" returned: 0 in 0.312s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info is being set with open permissions: ugo+rw Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:51 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info Sep 28 15:23:51 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:51 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.info" returned: 0 in 0.309s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.217s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.794s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Creating offline snapshot 206b7b4e-aa95-42d3-b059-c55af26abc9f of volume 9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-9a3d8180-5eb2-40ea-b873-32249c53181a tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[304e348f-e04e-4ee6-b343-f8300374868e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 Sep 28 15:23:52 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" returned: 0 in 0.612s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f 1G Sep 28 15:23:52 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-c8d41b8e-2a1b-4549-aaf3-a022a25a6a42-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-c8d41b8e-2a1b-4549-aaf3-a022a25a6a42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 of volume 88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:53 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f 1G" returned: 0 in 0.711s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3a2ce4-a51a-41d9-a254-6b011287068e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:53 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f Sep 28 15:23:53 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 Sep 28 15:23:53 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f" returned: 0 in 0.479s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:53 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f is being set with open permissions: ugo+rw Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:53 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f Sep 28 15:23:53 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:53 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" returned: 0 in 0.547s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa02fd-90b4-4cb0-9d29-3ecdc9670fbd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 Sep 28 15:23:54 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f" returned: 0 in 0.461s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info Sep 28 15:23:54 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" returned: 0 in 0.541s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 Sep 28 15:23:54 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info" returned: 0 in 0.398s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info is being set with open permissions: ugo+rw Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info Sep 28 15:23:54 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42 Sep 28 15:23:54 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.info" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.246s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ad877bb3-abe4-4461-86e5-21841fd554f0 tempest-ProjectReaderTests-994541763 None] Create snapshot completed successfully Sep 28 15:23:55 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015.c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" returned: 0 in 0.397s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c8d41b8e-2a1b-4549-aaf3-a022a25a6a42" released by "_delete_snapshot" :: held 2.114s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" released by "delete_snapshot" :: held 2.150s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Created reservations ['3b68f0a2-0a81-41f0-9014-8ca821857926', 'a8c72bcd-60c5-454a-b1a1-0e737a803019', '5f9a18c6-9fb8-4d4b-b134-0fe294ae86ce', 'b510ab30-e636-462c-bd58-d03fcb6b861f'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-206b7b4e-aa95-42d3-b059-c55af26abc9f-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Lock "cinder-206b7b4e-aa95-42d3-b059-c55af26abc9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-206b7b4e-aa95-42d3-b059-c55af26abc9f" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-206b7b4e-aa95-42d3-b059-c55af26abc9f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Deleting offline snapshot 206b7b4e-aa95-42d3-b059-c55af26abc9f of volume 9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] snapshot_file for this snap is: volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-72d93598-7ff2-473d-8298-0a22ae305300 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-c8d41b8e-2a1b-4549-aaf3-a022a25a6a42-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dabcad-86eb-4988-88e0-0b019ef88797]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f Sep 28 15:23:55 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f" returned: 0 in 0.471s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[a807b17b-abad-4a11-9cb1-7ebb52cab704]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 Sep 28 15:23:56 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Lock "cinder-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:56 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" returned: 0 in 0.529s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[511779da-c1d6-404f-bc6d-24c4895a60a3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f Sep 28 15:23:56 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 Sep 28 15:23:56 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f" returned: 0 in 0.501s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f Sep 28 15:23:57 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" returned: 0 in 0.543s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015 Sep 28 15:23:57 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889.206b7b4e-aa95-42d3-b059-c55af26abc9f" returned: 0 in 0.316s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" returned: 0 in 0.305s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-206b7b4e-aa95-42d3-b059-c55af26abc9f" released by "_delete_snapshot" :: held 1.990s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015" released by "delete_volume" :: held 0.945s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" released by "delete_snapshot" :: held 2.033s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Created reservations ['4735536c-c740-42b2-8a19-aaaf0a1d4aaa', '56f2e401-e887-4fab-aaf0-92636d84c37a', '7d468166-4120-4932-9d9a-5557b99cc446', '87fecb77-c763-46af-a1cd-c2b46f37c00e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Created reservations ['21feda61-e842-481a-b65a-6348946c3413', 'dcc1c727-649f-4739-87c8-0528f6120d37', 'eea8f626-22bb-4368-9850-bb4cef7ae164', 'f2747dc6-f4b0-4f00-92e4-5a671126a911'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:23:57 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Delete snapshot completed successfully. Sep 28 15:23:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-845d16ca-b239-4827-816c-74d85ba5a166 tempest-ProjectReaderTests-994541763 None] Lock "cinder-206b7b4e-aa95-42d3-b059-c55af26abc9f-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:58 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-96e845b4-b49d-4ed2-bfc6-0c880726adae tempest-ProjectMemberTests-1538406198 None] Lock "cinder-88a5c1a3-4ee1-4d2d-9877-70d14cfbd015-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-9fb2f9cb-0ee6-448b-8485-b07ed9a96889-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Lock "cinder-9fb2f9cb-0ee6-448b-8485-b07ed9a96889-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c10b3-387b-4fdd-b64f-23c654a5ffd2]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:59 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 Sep 28 15:23:59 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (ba23f132-a5cd-477b-8e63-73b491269354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:59 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d65db12-2230-43d9-a893-37bbb4495f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" returned: 0 in 0.666s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d65db12-2230-43d9-a893-37bbb4495f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364398728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f863520b-e1d7-467e-aa0b-2105f807de66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:00Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cebaa32b-1e73-4c7b-8e3c-811ef225c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889 Sep 28 15:23:59 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cebaa32b-1e73-4c7b-8e3c-811ef225c578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21bc80f-165a-4ff1-a8a2-910444504560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21bc80f-165a-4ff1-a8a2-910444504560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f863520b-e1d7-467e-aa0b-2105f807de66', 'volume_name': 'volume-f863520b-e1d7-467e-aa0b-2105f807de66', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5ff09a-df6b-4245-94c8-17e57e4dd153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5ff09a-df6b-4245-94c8-17e57e4dd153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b0fbc1-cfe8-4b4a-aad4-7128804b2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Volume f863520b-e1d7-467e-aa0b-2105f807de66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f863520b-e1d7-467e-aa0b-2105f807de66', 'volume_size': 1} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364398728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f863520b-e1d7-467e-aa0b-2105f807de66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:00Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Creating volume f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:23:59 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:23:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:59 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 1073741824 Sep 28 15:23:59 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" returned: 0 in 0.345s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-9fb2f9cb-0ee6-448b-8485-b07ed9a96889" released by "delete_volume" :: held 1.130s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Created reservations ['0c4e1463-0173-403a-a3b4-b96021111c8b', '2bba7661-237d-4198-a2ce-59b62cc06e16', 'f7e2438d-6482-48f2-9992-cd5a1ae2b2d1', '6f3b6737-2676-4973-86e8-b118cc491190'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:00 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 1073741824" returned: 0 in 0.729s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 Sep 28 15:24:00 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.378s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Deleted volume successfully. Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-64680938-61af-4717-8c49-5fb68a7213dc tempest-ProjectReaderTests-994541763 None] Lock "cinder-9fb2f9cb-0ee6-448b-8485-b07ed9a96889-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:00 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66" returned: 0 in 0.351s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b0fbc1-cfe8-4b4a-aad4-7128804b2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f863520b-e1d7-467e-aa0b-2105f807de66', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37ad393-9788-4463-9ddc-5202df6014b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Volume volume-f863520b-e1d7-467e-aa0b-2105f807de66 (f863520b-e1d7-467e-aa0b-2105f807de66): created successfully Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37ad393-9788-4463-9ddc-5202df6014b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (ba23f132-a5cd-477b-8e63-73b491269354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:01 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-61e325ba-517e-48c4-b427-188770a755a3 tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (c90ece0c-8a4c-4feb-8ea6-edf4f1cd7a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7426858-090a-42c3-941d-a03ac68ffc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7426858-090a-42c3-941d-a03ac68ffc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254018280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe46ae57-0f22-4973-891d-f1ff11dabcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:02Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a9f2ed-5488-47bc-84ff-8b1d91c55fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a9f2ed-5488-47bc-84ff-8b1d91c55fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5251a3ca-9cd1-4be3-aea4-9a4ecc41f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5251a3ca-9cd1-4be3-aea4-9a4ecc41f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe46ae57-0f22-4973-891d-f1ff11dabcc2', 'volume_name': 'volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3376818e-3492-4623-ab05-c77295e2a285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3376818e-3492-4623-ab05-c77295e2a285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdf7e50-984f-4811-93a6-463689098ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:01 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Volume fe46ae57-0f22-4973-891d-f1ff11dabcc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2', 'volume_size': 1} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254018280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe46ae57-0f22-4973-891d-f1ff11dabcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:02Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Creating volume fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:02 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:02 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 1073741824 Sep 28 15:24:02 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:02 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 1073741824" returned: 0 in 0.654s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:02 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 Sep 28 15:24:02 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:03 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2" returned: 0 in 0.362s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.985s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdf7e50-984f-4811-93a6-463689098ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db287d68-922d-45a8-9a7b-0f9165632f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 79da7a42-4c1c-4ca6-8753-ad667c7f7739 of volume f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:03 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Volume volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 (fe46ae57-0f22-4973-891d-f1ff11dabcc2): created successfully Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db287d68-922d-45a8-9a7b-0f9165632f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (c90ece0c-8a4c-4feb-8ea6-edf4f1cd7a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[082278d7-ed7a-4966-ae47-3cef5128e0dd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dcee7779-6d03-4b20-b059-d0ffff3924be tempest-ProjectReaderTests-994541763 None] Created volume successfully. Sep 28 15:24:03 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 Sep 28 15:24:03 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:03 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66" returned: 0 in 0.506s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:03 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 1G Sep 28 15:24:03 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:04 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 1G" returned: 0 in 0.713s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f863520b-e1d7-467e-aa0b-2105f807de66 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f863520b-e1d7-467e-aa0b-2105f807de66 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 Sep 28 15:24:04 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f863520b-e1d7-467e-aa0b-2105f807de66 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739" returned: 0 in 0.405s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 is being set with open permissions: ugo+rw Sep 28 15:24:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 Sep 28 15:24:04 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:05 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739" returned: 0 in 0.378s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:05 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info Sep 28 15:24:05 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:05 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info" returned: 0 in 0.336s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:05 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info is being set with open permissions: ugo+rw Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:05 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info Sep 28 15:24:05 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:05 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.info" returned: 0 in 0.285s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.555s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Creating offline snapshot 4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 of volume fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:05 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4fea804d-7ce7-476e-90d5-32146662af47 tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef7a5f9-e574-4c7c-8a4b-53024067372e]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 Sep 28 15:24:06 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-79da7a42-4c1c-4ca6-8753-ad667c7f7739-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-79da7a42-4c1c-4ca6-8753-ad667c7f7739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-f863520b-e1d7-467e-aa0b-2105f807de66" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-f863520b-e1d7-467e-aa0b-2105f807de66" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-79da7a42-4c1c-4ca6-8753-ad667c7f7739" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-79da7a42-4c1c-4ca6-8753-ad667c7f7739" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 79da7a42-4c1c-4ca6-8753-ad667c7f7739 of volume f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:06 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2" returned: 0 in 0.580s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[46479a6d-e6a3-4928-b50b-c4791b931fc7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 1G Sep 28 15:24:06 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 Sep 28 15:24:06 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739" returned: 0 in 0.462s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f863520b-e1d7-467e-aa0b-2105f807de66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f886a-80aa-4935-9109-c31650d4c44d]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 1G" returned: 0 in 0.617s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 Sep 28 15:24:07 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 Sep 28 15:24:07 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" returned: 0 in 0.469s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 is being set with open permissions: ugo+rw Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 Sep 28 15:24:07 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66" returned: 0 in 0.632s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 Sep 28 15:24:07 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" returned: 0 in 0.361s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info Sep 28 15:24:08 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739" returned: 0 in 0.442s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739 Sep 28 15:24:08 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info" returned: 0 in 0.272s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info is being set with open permissions: ugo+rw Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info Sep 28 15:24:08 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66.79da7a42-4c1c-4ca6-8753-ad667c7f7739" returned: 0 in 0.270s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-79da7a42-4c1c-4ca6-8753-ad667c7f7739" released by "_delete_snapshot" :: held 1.994s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-f863520b-e1d7-467e-aa0b-2105f807de66" released by "delete_snapshot" :: held 2.030s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:08 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.info" returned: 0 in 0.299s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Created reservations ['541b89cc-429b-4160-90e1-4ba39e08c8a8', '763ec388-ec9e-4a15-a8a4-1788768379ac', '9673b62b-613b-43fd-9bc5-b1c17c5771cc', 'e9c183e1-2548-4c25-8b8b-fee28d92763c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fc76b38b-bdad-481a-96a9-2138be592d52 tempest-ProjectReaderTests-994541763 None] Create snapshot completed successfully Sep 28 15:24:08 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-0c5b15ed-9a83-4d24-b543-5b5f302f4724 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-79da7a42-4c1c-4ca6-8753-ad667c7f7739-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Flow 'volume_create_manager' (6e9f84ce-0634-47a1-a9e3-cadd8208daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4656cdfa-bed8-41ca-bd24-248990dee135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4656cdfa-bed8-41ca-bd24-248990dee135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1613562102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887f2b0a-888f-4cdf-bbb4-e8435fa06e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe66b692f04c43e993c75728d6516a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:09Z,use_quota=True,user_id='6ff2dc1f29594c05b9c854fb6c7d2536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e591a3b8-f214-48f9-824f-c81a2eeb2f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e591a3b8-f214-48f9-824f-c81a2eeb2f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47babf89-f23b-43ba-8e3d-ba482f2dbb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47babf89-f23b-43ba-8e3d-ba482f2dbb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887f2b0a-888f-4cdf-bbb4-e8435fa06e4d', 'volume_name': 'volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba1f653-c7dc-4301-ad86-835427cf8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba1f653-c7dc-4301-ad86-835427cf8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639cb48f-819f-4ea8-9405-a6ceca564f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Volume 887f2b0a-888f-4cdf-bbb4-e8435fa06e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d', 'volume_size': 1} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1613562102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887f2b0a-888f-4cdf-bbb4-e8435fa06e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe66b692f04c43e993c75728d6516a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:09Z,use_quota=True,user_id='6ff2dc1f29594c05b9c854fb6c7d2536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Creating volume 887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:08 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d 1073741824 Sep 28 15:24:09 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:09 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d 1073741824" returned: 0 in 0.462s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:09 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-4fcdb970-cc1d-44e7-96a7-88a4c3d46f14-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Lock "cinder-4fcdb970-cc1d-44e7-96a7-88a4c3d46f14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-fe46ae57-0f22-4973-891d-f1ff11dabcc2" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-f863520b-e1d7-467e-aa0b-2105f807de66-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-f863520b-e1d7-467e-aa0b-2105f807de66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-fe46ae57-0f22-4973-891d-f1ff11dabcc2" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Deleting offline snapshot 4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 of volume fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:09 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] snapshot_file for this snap is: volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.348s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d19323-d0ef-4e7f-afd3-1977a7f68517]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-f863520b-e1d7-467e-aa0b-2105f807de66" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639cb48f-819f-4ea8-9405-a6ceca564f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121616bb-c6fb-4ef6-b88e-6ee73012551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Volume volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d (887f2b0a-888f-4cdf-bbb4-e8435fa06e4d): created successfully Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121616bb-c6fb-4ef6-b88e-6ee73012551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Flow 'volume_create_manager' (6e9f84ce-0634-47a1-a9e3-cadd8208daf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-f863520b-e1d7-467e-aa0b-2105f807de66" acquired by "delete_volume" :: waited 0.059s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-f5816577-5e31-44e5-91a3-b39a9165875d tempest-SnapshotDependencyTests-1541561290 None] Created volume successfully. Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04eeaf-8b9b-4019-99c6-38a0e0ce30ec]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 Sep 28 15:24:09 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 Sep 28 15:24:10 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" returned: 0 in 0.442s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e3542-62a2-4d7a-a04e-fad3377979e8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:10 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66" returned: 0 in 0.403s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:10 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66 Sep 28 15:24:10 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 Sep 28 15:24:10 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-f863520b-e1d7-467e-aa0b-2105f807de66" returned: 0 in 0.256s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-f863520b-e1d7-467e-aa0b-2105f807de66" released by "delete_volume" :: held 0.737s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:10 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2" returned: 0 in 0.401s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Created reservations ['8b7f4b29-5e3a-47c9-940f-e20dae400590', 'd3e5d708-f3f3-4865-bd0f-f21c16bbdce8', 'e0c16b73-345c-4ffd-be0c-bfdf71807158', 'c8d123f6-0788-49b6-8fdb-d4feb708a7b8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:10 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 Sep 28 15:24:10 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:10 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:10 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:11 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.332s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ee35b443-6ea7-48a5-acfc-f00108913bb2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-f863520b-e1d7-467e-aa0b-2105f807de66-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:11 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" returned: 0 in 0.506s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:11 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14 Sep 28 15:24:11 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Creating offline snapshot ce6368d8-efbf-4ade-9b74-aad366784c6a of volume 887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[102eccf4-defb-4f1b-9da0-3da0de676428]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:11 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2.4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" returned: 0 in 0.297s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:11 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:11 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-4fcdb970-cc1d-44e7-96a7-88a4c3d46f14" released by "_delete_snapshot" :: held 1.798s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-fe46ae57-0f22-4973-891d-f1ff11dabcc2" released by "delete_snapshot" :: held 1.841s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (ebaeb643-6bc8-4cdc-a0c0-5cc2b5fbbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267934ad-15aa-4c19-830a-93aad14e38ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267934ad-15aa-4c19-830a-93aad14e38ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820052904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46550fd-d86d-4e57-9441-a9b315ee0ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:12Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3804a6-e3c7-4c54-99ab-1d280c091cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3804a6-e3c7-4c54-99ab-1d280c091cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b157d4-720d-4ba7-b95a-9927778811ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b157d4-720d-4ba7-b95a-9927778811ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46550fd-d86d-4e57-9441-a9b315ee0ea1', 'volume_name': 'volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71dc8d3-1765-4970-9865-b35ac66b2df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71dc8d3-1765-4970-9865-b35ac66b2df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6f2bee-88db-450c-a022-64b18b5ac452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:11 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Volume e46550fd-d86d-4e57-9441-a9b315ee0ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1', 'volume_size': 1} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Created reservations ['cc913fa7-5159-4ee5-a4d7-8658dd3268a5', '48309d0c-85f0-4646-9ad3-56112ed93263', 'b871ff44-519b-4eec-9be3-a3f03ed9370f', '788d10e3-081d-490c-ba7f-0a3be68741c9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:11 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.410s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Delete snapshot completed successfully. Sep 28 15:24:11 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a 1G Sep 28 15:24:11 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-381596ee-886b-4d07-8f75-277f6a987075 tempest-ProjectReaderTests-994541763 None] Lock "cinder-4fcdb970-cc1d-44e7-96a7-88a4c3d46f14-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:12 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a 1G" returned: 0 in 0.448s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:12 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a Sep 28 15:24:12 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:12 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a" returned: 0 in 0.293s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:12 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a is being set with open permissions: ugo+rw Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:12 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a Sep 28 15:24:12 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:12 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a" returned: 0 in 0.244s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-fe46ae57-0f22-4973-891d-f1ff11dabcc2-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:12 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info Sep 28 15:24:12 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:12 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Lock "cinder-fe46ae57-0f22-4973-891d-f1ff11dabcc2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-fe46ae57-0f22-4973-891d-f1ff11dabcc2" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-fe46ae57-0f22-4973-891d-f1ff11dabcc2" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b841d82c-19bd-4c1a-861c-bb466a6cc3b0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:13 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info" returned: 0 in 0.287s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:13 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info is being set with open permissions: ugo+rw Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:13 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info Sep 28 15:24:13 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:13 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 Sep 28 15:24:13 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:13 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.info" returned: 0 in 0.267s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820052904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46550fd-d86d-4e57-9441-a9b315ee0ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:12Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Creating volume e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:13 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:13 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:13 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 1073741824 Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2" returned: 0 in 0.418s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:13 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:13 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2 Sep 28 15:24:13 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a042b667-c562-4ca1-9f1f-250cdd24725f tempest-SnapshotDependencyTests-1541561290 None] Create snapshot completed successfully Sep 28 15:24:13 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-fe46ae57-0f22-4973-891d-f1ff11dabcc2" returned: 0 in 0.280s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-fe46ae57-0f22-4973-891d-f1ff11dabcc2" released by "delete_volume" :: held 0.765s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Created reservations ['df9e460f-c959-47d2-99b6-02a7248b379a', 'bc0a98c8-5d8c-4d7d-833d-cb5e8921d07c', '8896d4ed-db77-4eba-a184-cacc405eb366', 'bc213267-5f8b-4df7-8b60-ccd25e2db94c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:13 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:13 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 1073741824" returned: 0 in 0.485s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:13 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:14 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 Sep 28 15:24:14 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:14 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.278s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Deleted volume successfully. Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba1d41bb-544b-4f83-91ea-7670e2eb5a2f tempest-ProjectReaderTests-994541763 None] Lock "cinder-fe46ae57-0f22-4973-891d-f1ff11dabcc2-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:14 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1" returned: 0 in 0.266s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6f2bee-88db-450c-a022-64b18b5ac452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a163ddd-9ed6-4ffb-8f87-a971dfaf4f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Volume volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 (e46550fd-d86d-4e57-9441-a9b315ee0ea1): created successfully Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a163ddd-9ed6-4ffb-8f87-a971dfaf4f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (ebaeb643-6bc8-4cdc-a0c0-5cc2b5fbbfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-db1790f7-0354-4b7e-93a7-e8e10559fe5e tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (dcf42ca1-e07e-42dc-89be-e09e022689da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2515d2-78b9-42ea-b065-369e6136ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2515d2-78b9-42ea-b065-369e6136ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202514647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b94e88-8100-4fe2-8f77-5f9dc1111b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:15Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af886ffb-60de-4d61-a87f-bad9e9ce8ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af886ffb-60de-4d61-a87f-bad9e9ce8ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02380d2b-6fb4-4ab0-a40d-3a0995e479f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02380d2b-6fb4-4ab0-a40d-3a0995e479f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b94e88-8100-4fe2-8f77-5f9dc1111b6d', 'volume_name': 'volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a960553f-aab0-4d66-b579-a5ba6c2146ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a960553f-aab0-4d66-b579-a5ba6c2146ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da18cb4-2546-4937-a393-072827fd11c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:14 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Volume 77b94e88-8100-4fe2-8f77-5f9dc1111b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d', 'volume_size': 1} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202514647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b94e88-8100-4fe2-8f77-5f9dc1111b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab3e77ddc544ed840910efa2a2af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:15Z,use_quota=True,user_id='96e9840a519c4ee5b77b765d42414413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Creating volume 77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:14 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:14 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d 1073741824 Sep 28 15:24:14 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:15 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d 1073741824" returned: 0 in 0.537s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Flow 'volume_create_manager' (b56e8ef5-18d8-4b4a-b37e-2338bc374eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b520a4c2-0d2b-4067-b474-175747a1b064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b520a4c2-0d2b-4067-b474-175747a1b064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c1117a-d8b2-4248-9ba2-83a3d413dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe66b692f04c43e993c75728d6516a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce6368d8-efbf-4ade-9b74-aad366784c6a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:15Z,use_quota=True,user_id='6ff2dc1f29594c05b9c854fb6c7d2536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf499708-7645-40e5-bedf-a44c522c7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf499708-7645-40e5-bedf-a44c522c7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27603a98-ad88-4523-a0fb-135d57857583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27603a98-ad88-4523-a0fb-135d57857583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1c1117a-d8b2-4248-9ba2-83a3d413dd32', 'volume_name': 'volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32', 'volume_size': 1, 'snapshot_id': 'ce6368d8-efbf-4ade-9b74-aad366784c6a'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaf2cc9-a310-4979-b3b8-32171c08178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaf2cc9-a310-4979-b3b8-32171c08178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3fcec-dc84-4812-ab85-5f506abbeb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:15 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Volume c1c1117a-d8b2-4248-9ba2-83a3d413dd32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32', 'volume_size': 1, 'snapshot_id': 'ce6368d8-efbf-4ade-9b74-aad366784c6a'} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:15 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d Sep 28 15:24:15 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:15 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" returned: 0 in 0.239s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.639s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 5487b66f-afdd-456c-8989-23b7117d71c8 of volume e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da18cb4-2546-4937-a393-072827fd11c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e267ef3d-b16a-472b-9529-bd0bd355c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee69561-5576-446b-bc69-f4c6eb2dc864]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:15 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Volume volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d (77b94e88-8100-4fe2-8f77-5f9dc1111b6d): created successfully Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e267ef3d-b16a-472b-9529-bd0bd355c84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:15 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Flow 'volume_create_manager' (dcf42ca1-e07e-42dc-89be-e09e022689da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:15 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-16dfe369-8ceb-4c22-81e4-4421aaaab3b6 tempest-ProjectReaderTests-994541763 None] Created volume successfully. Sep 28 15:24:15 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 Sep 28 15:24:15 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:16 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:16 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 1G Sep 28 15:24:16 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:16 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 1G" returned: 0 in 0.397s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:16 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 Sep 28 15:24:16 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:16 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8" returned: 0 in 0.338s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:16 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 is being set with open permissions: ugo+rw Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:16 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 Sep 28 15:24:16 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:16 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:17 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8" returned: 0 in 0.260s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:17 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info Sep 28 15:24:17 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:17 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info" returned: 0 in 0.259s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:17 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info is being set with open permissions: ugo+rw Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:17 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info Sep 28 15:24:17 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:17 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.info" returned: 0 in 0.248s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.230s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-quobyte-ce6368d8-efbf-4ade-9b74-aad366784c6a-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" by "_create_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-ce6368d8-efbf-4ade-9b74-aad366784c6a-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Creating volume c1c1117a-d8b2-4248-9ba2-83a3d413dd32 from snapshot ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-quobyte-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" by "_copy_volume_from_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] snapshot: ce6368d8-efbf-4ade-9b74-aad366784c6a, volume: c1c1117a-d8b2-4248-9ba2-83a3d413dd32, {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:17 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e828ea03-feaa-494b-b77a-c32f417ccadd tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6a5b8-3b09-496e-a517-3b315c218d6b]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:17 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:17 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a Sep 28 15:24:17 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a" returned: 0 in 0.407s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Creating direct copy from snapshot {{(pid=86888) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48cb964-d051-45bb-bf7f-44acacab5b38]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-5487b66f-afdd-456c-8989-23b7117d71c8-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-5487b66f-afdd-456c-8989-23b7117d71c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-e46550fd-d86d-4e57-9441-a9b315ee0ea1" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-e46550fd-d86d-4e57-9441-a9b315ee0ea1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-5487b66f-afdd-456c-8989-23b7117d71c8" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-5487b66f-afdd-456c-8989-23b7117d71c8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 5487b66f-afdd-456c-8989-23b7117d71c8 of volume e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:18 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:18 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e952dc-b898-498c-aad2-5335fdd707a8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 Sep 28 15:24:18 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.420s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.utils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Path /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 not found in is_blk_device check {{(pid=86888) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 Sep 28 15:24:18 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149fd2a-0f2f-4fbb-a1f1-c3ba7c3ca995]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:18 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 Sep 28 15:24:18 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:19 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1" returned: 0 in 0.490s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:19 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 Sep 28 15:24:19 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:19 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8" returned: 0 in 0.685s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:19 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:19 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8 Sep 28 15:24:19 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:20 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:20 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1.5487b66f-afdd-456c-8989-23b7117d71c8" returned: 0 in 0.543s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-5487b66f-afdd-456c-8989-23b7117d71c8" released by "_delete_snapshot" :: held 2.304s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-e46550fd-d86d-4e57-9441-a9b315ee0ea1" released by "delete_snapshot" :: held 2.341s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:20 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Created reservations ['625383e3-a87b-46ad-8a7d-2bfe7ce47b88', 'b0e0e06a-33d6-4df9-baea-494b59abac32', 'b65aa1bf-d7cb-4fa9-8361-4e7ec10993ac', '6206ce08-52ce-4e17-9cce-efbe0138ad08'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:20 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:24:20 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b1666e8c-e844-4592-a00b-6da9e8d75df6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-5487b66f-afdd-456c-8989-23b7117d71c8-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-e46550fd-d86d-4e57-9441-a9b315ee0ea1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Lock "cinder-e46550fd-d86d-4e57-9441-a9b315ee0ea1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:UPDATE=167,cinder:SELECT=132,cinder:INSERT=46,cinder:DELETE=16 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=136,cinder:INSERT=43,cinder:UPDATE=163,cinder:DELETE=12 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-e46550fd-d86d-4e57-9441-a9b315ee0ea1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-e46550fd-d86d-4e57-9441-a9b315ee0ea1" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7533e1-9fe4-46b9-83ab-cba2dbedc501]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:21 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:22 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 Sep 28 15:24:22 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:22 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1" returned: 0 in 0.681s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:22 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:22 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1 Sep 28 15:24:22 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:23 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-e46550fd-d86d-4e57-9441-a9b315ee0ea1" returned: 0 in 0.491s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-e46550fd-d86d-4e57-9441-a9b315ee0ea1" released by "delete_volume" :: held 1.322s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Created reservations ['22db2b60-682a-4538-808c-223871f0c247', '03a6ae83-08c1-40dd-8bbf-0da1374071d2', '7c0b31bb-5708-4a70-bbad-bf89a1dc90f9', '159a9d37-4fc6-4d29-8e8d-8527847a93b4'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:23 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:23 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:23 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.485s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:23 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:24:23 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c329cd29-2c3a-446e-8a34-22088175a50a tempest-ProjectMemberTests-1538406198 None] Lock "cinder-e46550fd-d86d-4e57-9441-a9b315ee0ea1-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (12db13f3-30f8-4fa3-888f-4864b7e056ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42be4e1-7c80-423f-a96c-56e9c1d49c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42be4e1-7c80-423f-a96c-56e9c1d49c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888630975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ff557-cce9-48b9-aeea-1728ebf1b8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:25Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91909c8-d23a-45f2-b77b-df12573c2007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91909c8-d23a-45f2-b77b-df12573c2007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a18910-cb09-411c-b59d-683fb2a56fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a18910-cb09-411c-b59d-683fb2a56fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45ff557-cce9-48b9-aeea-1728ebf1b8c0', 'volume_name': 'volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc375f1-15d1-4060-97de-3cb05af57c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:24 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc375f1-15d1-4060-97de-3cb05af57c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:25 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bbbaa8-02de-4fdd-a778-d8dc6537621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:25 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Volume c45ff557-cce9-48b9-aeea-1728ebf1b8c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0', 'volume_size': 1} Sep 28 15:24:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:25 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" returned: 0 in 7.073s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:25 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[622cd595-f6ce-4cee-a615-ce907e82ef22]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:25 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:25 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:25 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:26 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.565s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.image.image_utils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Image conversion details: src /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 {{(pid=86888) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 28 15:24:26 devstack cinder-volume[86888]: INFO cinder.image.image_utils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Converted 1024.00 MB image at 144.74 MB/s Sep 28 15:24:26 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 is being set with open permissions: ugo+rw Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:26 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 Sep 28 15:24:26 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:26 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" returned: 0 in 0.270s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" released by "_copy_volume_from_snapshot" :: held 8.844s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-ce6368d8-efbf-4ade-9b74-aad366784c6a-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" released by "_create_volume_from_snapshot" :: held 8.877s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.901s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.619s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Creating offline snapshot caef5916-ed82-428c-be82-5ae5483b6373 of volume 77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3fcec-dc84-4812-ab85-5f506abbeb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32', 'volume_size': 1, 'snapshot_id': 'ce6368d8-efbf-4ade-9b74-aad366784c6a'}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719911b3-9880-4ed6-9c96-46dde416a26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833e6ea-010f-4535-bffd-6c4403d3d654]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Volume volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 (c1c1117a-d8b2-4248-9ba2-83a3d413dd32): created successfully Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719911b3-9880-4ed6-9c96-46dde416a26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Flow 'volume_create_manager' (b56e8ef5-18d8-4b4a-b37e-2338bc374eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:26 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2b211e71-70f9-4d02-a725-cfacfa207254 tempest-SnapshotDependencyTests-1541561290 None] Created volume successfully. Sep 28 15:24:26 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d Sep 28 15:24:26 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:26 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:27 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 1G Sep 28 15:24:27 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:27 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 1G" returned: 0 in 0.526s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-ce6368d8-efbf-4ade-9b74-aad366784c6a-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:27 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 Sep 28 15:24:27 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-ce6368d8-efbf-4ade-9b74-aad366784c6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-quobyte-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-quobyte-ce6368d8-efbf-4ade-9b74-aad366784c6a" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-ce6368d8-efbf-4ade-9b74-aad366784c6a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Deleting offline snapshot ce6368d8-efbf-4ade-9b74-aad366784c6a of volume 887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] snapshot_file for this snap is: volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1275d52-b927-44af-97d3-58c4ee9aa968]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:27 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a Sep 28 15:24:27 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:27 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373" returned: 0 in 0.355s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:27 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 is being set with open permissions: ugo+rw Sep 28 15:24:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:27 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 Sep 28 15:24:27 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:28 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a" returned: 0 in 0.407s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba71e53-459d-4a7a-ac8a-beccb33b8886]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:28 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373" returned: 0 in 0.322s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:28 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:28 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:28 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info Sep 28 15:24:28 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:28 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:28 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.448s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info" returned: 0 in 0.342s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:28 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info is being set with open permissions: ugo+rw Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:28 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a Sep 28 15:24:28 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:28 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info Sep 28 15:24:28 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:28 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.info" returned: 0 in 0.286s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.861s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888630975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ff557-cce9-48b9-aeea-1728ebf1b8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:25Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Creating volume c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:28 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:28 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 1073741824 Sep 28 15:24:28 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-68eb7a31-4184-4729-860d-209e0e885508 tempest-ProjectReaderTests-994541763 None] Create snapshot completed successfully Sep 28 15:24:28 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a" returned: 0 in 0.382s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:28 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a Sep 28 15:24:28 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:29 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d.ce6368d8-efbf-4ade-9b74-aad366784c6a" returned: 0 in 0.287s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-ce6368d8-efbf-4ade-9b74-aad366784c6a" released by "_delete_snapshot" :: held 1.657s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" released by "delete_snapshot" :: held 1.687s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Created reservations ['477188e6-c33a-44a4-b1b0-73a40a174240', 'f2f94256-80a0-4d9c-ae37-21d527d4cdda', '0dfc7ad1-682a-4d74-9afd-c6b870e661fe', '792e88ec-0bf2-494b-88cb-30871e36e57a'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:29 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 1073741824" returned: 0 in 0.526s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Delete snapshot completed successfully. Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-e8443c66-efe3-4ea5-84ab-1f0cfac1de04 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-ce6368d8-efbf-4ade-9b74-aad366784c6a-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:29 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 Sep 28 15:24:29 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-caef5916-ed82-428c-be82-5ae5483b6373-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Lock "cinder-caef5916-ed82-428c-be82-5ae5483b6373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-caef5916-ed82-428c-be82-5ae5483b6373" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-caef5916-ed82-428c-be82-5ae5483b6373" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Deleting offline snapshot caef5916-ed82-428c-be82-5ae5483b6373 of volume 77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] snapshot_file for this snap is: volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb044f5b-9603-40ec-9efd-33f287c8842f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:29 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" returned: 0 in 0.289s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bbbaa8-02de-4fdd-a778-d8dc6537621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcef7c9-3c76-45bb-aead-16d46fdba2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:29 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Volume volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 (c45ff557-cce9-48b9-aeea-1728ebf1b8c0): created successfully Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcef7c9-3c76-45bb-aead-16d46fdba2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (12db13f3-30f8-4fa3-888f-4864b7e056ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:29 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 Sep 28 15:24:29 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:29 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b60b47c0-37f4-46f3-81bc-d747878cca36 tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-quobyte-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[96183fe2-746d-4f52-af35-d49d4d76b566]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:30 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fafa0a-cd8f-46c8-93ce-f031c9e72b1c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d Sep 28 15:24:30 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot c34449bc-5c00-413e-85f3-fc23f7dd8980 of volume c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:30 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.472s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fc92d-a64a-4bd2-bfe2-1660bb9c43e7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d Sep 28 15:24:30 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 Sep 28 15:24:30 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" returned: 0 in 0.436s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 Sep 28 15:24:30 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" returned: 0 in 0.309s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d" released by "delete_volume" :: held 0.849s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Created reservations ['ae7e16db-cb0a-455a-876d-614282193e89', 'ff275781-9ddd-45ac-8ebc-9e71fcb99ecc', 'a15dae7b-0ba7-4b44-ac46-eddae6955818', 'ff8b8636-259c-466a-aa83-e25a8d42f0f9'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:30 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 1G Sep 28 15:24:30 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:30 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-c1c1117a-d8b2-4248-9ba2-83a3d413dd32-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-c1c1117a-d8b2-4248-9ba2-83a3d413dd32-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "cinder-quobyte-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:31 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373" returned: 0 in 0.489s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8b0b7e-09fd-49f2-9d6c-c102b6e074c1]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:31 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373 Sep 28 15:24:31 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:31 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 Sep 28 15:24:31 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:31 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.375s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Deleted volume successfully. Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-b636fa9f-bd1d-4faa-82de-9050c8c16d67 tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-887f2b0a-888f-4cdf-bbb4-e8435fa06e4d-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:31 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 1G" returned: 0 in 0.577s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:31 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 Sep 28 15:24:31 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:31 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d.caef5916-ed82-428c-be82-5ae5483b6373" returned: 0 in 0.341s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-caef5916-ed82-428c-be82-5ae5483b6373" released by "_delete_snapshot" :: held 1.826s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" released by "delete_snapshot" :: held 1.856s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Created reservations ['f471a9e4-2301-4420-8a44-ae42ded104f3', '903c3058-79ce-478e-b5ab-613fce2a2db1', '3e4d276c-d798-4d4e-961b-b72f16a8357c', '22408da4-c3d2-480d-861b-945a6b509dbb'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:31 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" returned: 0 in 0.501s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Delete snapshot completed successfully. Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5ff9096a-c1b0-4c3b-b378-83724889ccd4 tempest-ProjectReaderTests-994541763 None] Lock "cinder-caef5916-ed82-428c-be82-5ae5483b6373-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:31 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32 Sep 28 15:24:31 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:31 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980" returned: 0 in 0.365s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 is being set with open permissions: ugo+rw Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:31 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 Sep 28 15:24:31 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-77b94e88-8100-4fe2-8f77-5f9dc1111b6d-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Lock "cinder-77b94e88-8100-4fe2-8f77-5f9dc1111b6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Acquiring lock "cinder-quobyte-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:31 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" returned: 0 in 0.317s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-quobyte-c1c1117a-d8b2-4248-9ba2-83a3d413dd32" released by "delete_volume" :: held 0.875s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf0d30-ae6f-47e8-8554-e53af7b09bf0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Created reservations ['b21b58b9-a7dc-4cf1-adbf-a53c331c1dd0', '2db3c407-7d84-4a1d-b3e2-ddb8cd5a0253', 'b18ae88e-dd89-4cf9-9aef-7abb94744001', 'bfc4035f-2c59-476d-a3e3-56cfedd74ff0'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:32 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:32 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d Sep 28 15:24:32 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980" returned: 0 in 0.374s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:32 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:32 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:32 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info Sep 28 15:24:32 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:32 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" returned: 0 in 0.506s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:32 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:32 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.366s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info" returned: 0 in 0.325s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:32 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info is being set with open permissions: ugo+rw Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:32 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d Sep 28 15:24:32 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Deleted volume successfully. Sep 28 15:24:32 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info Sep 28 15:24:32 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-c5455f56-87cb-4390-82f3-e487495777ed tempest-SnapshotDependencyTests-1541561290 None] Lock "cinder-c1c1117a-d8b2-4248-9ba2-83a3d413dd32-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:32 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" returned: 0 in 0.306s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:32 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.info" returned: 0 in 0.286s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Lock "cinder-quobyte-77b94e88-8100-4fe2-8f77-5f9dc1111b6d" released by "delete_volume" :: held 0.921s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:32 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-b0074d8c-a5ee-4e6f-a0ec-19f73c2e9547 tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:24:32 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Created reservations ['cbdd4d0a-e955-4597-b5d9-d5266dffd07e', 'da37520c-5bca-4a9d-8d29-e9be22774876', 'eb197c3b-9b4c-4b61-a589-8313beba7f52', '3279ba18-5dc2-403a-8b7c-684565e1ca91'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:33 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:33 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:33 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.303s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:33 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Deleted volume successfully. Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-82c00bc4-df6c-459c-8046-6fb5c31c1b6c tempest-ProjectReaderTests-994541763 None] Lock "cinder-77b94e88-8100-4fe2-8f77-5f9dc1111b6d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-c34449bc-5c00-413e-85f3-fc23f7dd8980-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-c34449bc-5c00-413e-85f3-fc23f7dd8980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-c34449bc-5c00-413e-85f3-fc23f7dd8980" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c34449bc-5c00-413e-85f3-fc23f7dd8980" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot c34449bc-5c00-413e-85f3-fc23f7dd8980 of volume c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fc79c8-6ca4-4247-aafa-2b5280d19e0f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:33 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:33 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 Sep 28 15:24:33 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:34 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980" returned: 0 in 0.477s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:34 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:34 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2d97a-3256-4611-9153-ad34f51728e7]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:34 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 Sep 28 15:24:34 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:34 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" returned: 0 in 0.524s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:34 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:34 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 Sep 28 15:24:34 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:35 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980" returned: 0 in 0.464s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:35 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980 Sep 28 15:24:35 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:35 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0.c34449bc-5c00-413e-85f3-fc23f7dd8980" returned: 0 in 0.353s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c34449bc-5c00-413e-85f3-fc23f7dd8980" released by "_delete_snapshot" :: held 1.957s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" released by "delete_snapshot" :: held 1.984s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Created reservations ['33e2b44d-4b2c-4b18-93fe-26d6a1eec539', '189bb117-bf71-4847-98a7-a19ffc3d3571', 'af6d8fa7-38bb-47a0-aa19-79f0ffe4883c', '45e8bedb-4542-49ba-8202-c2528497b0c8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:35 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:24:35 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-3c019469-2cc7-4856-89f3-22fb0f1fe4a6 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-c34449bc-5c00-413e-85f3-fc23f7dd8980-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-c45ff557-cce9-48b9-aeea-1728ebf1b8c0-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-c45ff557-cce9-48b9-aeea-1728ebf1b8c0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:36 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" acquired by "delete_volume" :: waited 0.023s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:37 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f67f4-1f10-4cff-8774-fc173f85f3dd]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:37 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 Sep 28 15:24:37 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:37 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" returned: 0 in 0.431s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:37 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0 Sep 28 15:24:37 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:37 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:37 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" returned: 0 in 0.412s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:37 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-c45ff557-cce9-48b9-aeea-1728ebf1b8c0" released by "delete_volume" :: held 0.938s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Created reservations ['f037e3ea-0451-4d29-984b-c680cf9449b8', 'c554b360-bc9a-49b8-9fba-8fb9847b406c', '05b843a4-fbd0-43a4-8600-903cf7f0208d', 'a4d67e9f-bf90-42f1-bd83-058599872d60'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:38 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:38 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:38 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.321s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:38 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:24:38 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-6bb974f8-7944-4263-9a89-6d9cd025cab4 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-c45ff557-cce9-48b9-aeea-1728ebf1b8c0-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (fd4144cf-cd15-44f4-844a-920fa8785a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9acfd2-3ae1-4074-829f-1cae8ad2c243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9acfd2-3ae1-4074-829f-1cae8ad2c243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668190464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2fb82e-12cc-40e4-a094-0a1b1672835f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c75455-e4b4-410c-aac8-31b895b5882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c75455-e4b4-410c-aac8-31b895b5882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44dd065e-ee9f-410b-b597-ce77427f9e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44dd065e-ee9f-410b-b597-ce77427f9e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2fb82e-12cc-40e4-a094-0a1b1672835f', 'volume_name': 'volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52488eaf-23f4-4d33-845e-58eb04cf1326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52488eaf-23f4-4d33-845e-58eb04cf1326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8ed4b5-223f-494b-ada1-7869a4a54043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:39 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Volume 0b2fb82e-12cc-40e4-a094-0a1b1672835f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f', 'volume_size': 1} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668190464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2fb82e-12cc-40e4-a094-0a1b1672835f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Creating volume 0b2fb82e-12cc-40e4-a094-0a1b1672835f {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:39 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:39 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:39 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f 1073741824 Sep 28 15:24:39 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (7606f002-9784-49c8-91fc-f5ec4f337cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128c19cf-5db4-438d-90b6-e88161bb1769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128c19cf-5db4-438d-90b6-e88161bb1769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983751948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c502d29-173b-4fbf-9d12-c965651913b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3274ccfa-c6a2-4fbe-9e64-bfae4d3f4531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3274ccfa-c6a2-4fbe-9e64-bfae4d3f4531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c82eaef-a0e7-4045-8089-58ff11ff5f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c82eaef-a0e7-4045-8089-58ff11ff5f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c502d29-173b-4fbf-9d12-c965651913b1', 'volume_name': 'volume-6c502d29-173b-4fbf-9d12-c965651913b1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144e131c-0d1a-4e6f-9c23-0b6c40025021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144e131c-0d1a-4e6f-9c23-0b6c40025021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0827640d-e69c-491b-b422-82f59db9859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Volume 6c502d29-173b-4fbf-9d12-c965651913b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c502d29-173b-4fbf-9d12-c965651913b1', 'volume_size': 1} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:40 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f 1073741824" returned: 0 in 0.494s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f Sep 28 15:24:40 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:40 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f" returned: 0 in 0.261s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983751948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c502d29-173b-4fbf-9d12-c965651913b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:40Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Creating volume 6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:40 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 1073741824 Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8ed4b5-223f-494b-ada1-7869a4a54043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bf927a-879b-4fdd-82ce-ac863450298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:40 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Volume volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f (0b2fb82e-12cc-40e4-a094-0a1b1672835f): created successfully Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bf927a-879b-4fdd-82ce-ac863450298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (fd4144cf-cd15-44f4-844a-920fa8785a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:40 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-0610720a-bcd5-4a6c-b21c-f54aa2902a91 tempest-ProjectReaderTests-1893651530 None] Created volume successfully. Sep 28 15:24:40 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.344s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:24:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:24:41 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 1073741824" returned: 0 in 0.551s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 Sep 28 15:24:41 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1" returned: 0 in 0.235s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0827640d-e69c-491b-b422-82f59db9859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c502d29-173b-4fbf-9d12-c965651913b1', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c90aa4-914e-479b-9cb0-565d2c5b1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:41 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Volume volume-6c502d29-173b-4fbf-9d12-c965651913b1 (6c502d29-173b-4fbf-9d12-c965651913b1): created successfully Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c90aa4-914e-479b-9cb0-565d2c5b1942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (7606f002-9784-49c8-91fc-f5ec4f337cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:41 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-4d5fb1df-7411-4250-94f8-2b3260a3e7f6 tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-0b2fb82e-12cc-40e4-a094-0a1b1672835f-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:41 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-0b2fb82e-12cc-40e4-a094-0a1b1672835f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-quobyte-0b2fb82e-12cc-40e4-a094-0a1b1672835f" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-0b2fb82e-12cc-40e4-a094-0a1b1672835f" acquired by "delete_volume" :: waited 0.040s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9495ba-95e3-4238-be0f-b969df33a43f]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f Sep 28 15:24:42 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 0d32ab38-97ba-401b-b2d5-1da91ea40729 of volume 6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c98df-4c95-439c-88db-138d4d9fe609]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 Sep 28 15:24:42 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f" returned: 0 in 0.426s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f Sep 28 15:24:42 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-0b2fb82e-12cc-40e4-a094-0a1b1672835f" returned: 0 in 0.258s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-0b2fb82e-12cc-40e4-a094-0a1b1672835f" released by "delete_volume" :: held 0.781s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1" returned: 0 in 0.441s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 1G Sep 28 15:24:42 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Created reservations ['8a2b7e7a-0926-40bf-8d02-50a9c95580d8', '3d111283-f7d5-46e6-b6a6-7914657d76f1', 'b213d031-66f2-4546-8f51-8dc6987834cb', 'f1957008-4590-43bd-a1d3-0c91f74ca821'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:43 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:43 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 1G" returned: 0 in 0.609s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c502d29-173b-4fbf-9d12-c965651913b1 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.423s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:43 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Deleted volume successfully. Sep 28 15:24:43 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c502d29-173b-4fbf-9d12-c965651913b1 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 Sep 28 15:24:43 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-85cbf4a9-14d8-4376-a371-e329ddeeece2 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-0b2fb82e-12cc-40e4-a094-0a1b1672835f-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:43 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c502d29-173b-4fbf-9d12-c965651913b1 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729" returned: 0 in 0.377s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 is being set with open permissions: ugo+rw Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:43 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 Sep 28 15:24:43 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (7eb07fa8-bc15-446f-9d93-4cd77bfd3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db4a0a6-a4e3-4bbc-a340-c0ba7e5b7b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db4a0a6-a4e3-4bbc-a340-c0ba7e5b7b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559667863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:44Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b016538e-9fb7-47bd-aa4c-c487bea768c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b016538e-9fb7-47bd-aa4c-c487bea768c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34e730d-a9fa-41b1-ab0d-f4b0a97e4474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34e730d-a9fa-41b1-ab0d-f4b0a97e4474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4', 'volume_name': 'volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1260480-9218-4999-b56d-9a99b53bd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1260480-9218-4999-b56d-9a99b53bd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845ef2ab-26bd-4d9b-b0ba-2ebadeae0e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:43 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Volume bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4', 'volume_size': 1} Sep 28 15:24:43 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729" returned: 0 in 0.310s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info Sep 28 15:24:44 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info" returned: 0 in 0.305s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info is being set with open permissions: ugo+rw Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info Sep 28 15:24:44 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.info" returned: 0 in 0.307s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559667863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:44Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Creating volume bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:44 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:44 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 1073741824 Sep 28 15:24:44 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1fdf5a33-6f10-47d8-9582-4c76660fe011 tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:24:45 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 1073741824" returned: 0 in 0.504s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:45 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 Sep 28 15:24:45 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-0d32ab38-97ba-401b-b2d5-1da91ea40729-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Lock "cinder-0d32ab38-97ba-401b-b2d5-1da91ea40729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-6c502d29-173b-4fbf-9d12-c965651913b1" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-6c502d29-173b-4fbf-9d12-c965651913b1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-0d32ab38-97ba-401b-b2d5-1da91ea40729" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-0d32ab38-97ba-401b-b2d5-1da91ea40729" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 0d32ab38-97ba-401b-b2d5-1da91ea40729 of volume 6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:45 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4" returned: 0 in 0.323s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0f3fa-9a6e-45cc-83d6-1593c1cbb7dc]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845ef2ab-26bd-4d9b-b0ba-2ebadeae0e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89f28b4-5ce0-4792-ba07-9f989a5d8405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:45 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Volume volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 (bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4): created successfully Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89f28b4-5ce0-4792-ba07-9f989a5d8405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:45 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (7eb07fa8-bc15-446f-9d93-4cd77bfd3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:45 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-1bbe4766-fc3a-447f-820a-62d2579fc9a6 tempest-ProjectReaderTests-1893651530 None] Created volume successfully. Sep 28 15:24:45 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 Sep 28 15:24:45 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Lock "cinder-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-quobyte-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4" acquired by "delete_volume" :: waited 0.022s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c6965-e0fe-45dd-9d89-de337ec15348]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:46 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729" returned: 0 in 0.471s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c502d29-173b-4fbf-9d12-c965651913b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b5ee0-4782-4b5a-bfe2-75c60f818833]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:46 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 Sep 28 15:24:46 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:46 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 Sep 28 15:24:46 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:46 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4" returned: 0 in 0.417s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:46 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4 Sep 28 15:24:46 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:46 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1" returned: 0 in 0.454s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:46 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 Sep 28 15:24:46 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:46 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4" returned: 0 in 0.287s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4" released by "delete_volume" :: held 0.756s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:46 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Created reservations ['0d62a4a8-bfe7-4c61-b4e3-7672c06331c9', '68b4b0e2-4e1a-4db6-ba27-e34724129e33', '90eaf1f2-f5bf-4ca5-abf1-0ddd33863c6d', '58144386-be29-437d-b09a-b513ce6f3d27'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:47 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:47 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:47 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729" returned: 0 in 0.405s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:47 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729 Sep 28 15:24:47 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:47 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.279s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Deleted volume successfully. Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-2f132b61-a370-4adb-a714-33c4bf0436aa tempest-ProjectReaderTests-1893651530 None] Lock "cinder-bf1d8683-9737-4cc1-ad6d-fde9dc99f1d4-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:47 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1.0d32ab38-97ba-401b-b2d5-1da91ea40729" returned: 0 in 0.298s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-0d32ab38-97ba-401b-b2d5-1da91ea40729" released by "_delete_snapshot" :: held 1.766s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-6c502d29-173b-4fbf-9d12-c965651913b1" released by "delete_snapshot" :: held 1.796s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Created reservations ['3d89ccb8-63e9-43e0-bb0a-1e20d0683864', 'b5d03c12-b10d-48e9-8396-c282fc4dc4e7', 'e66298af-a97e-4f13-b594-babd6ed22749', '463dea3a-e9e6-4f9b-afec-1452fa4f612a'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:47 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-11fdaec4-fb5d-4fbc-a8b9-87e66d9a696b tempest-ProjectMemberTests-1538406198 None] Lock "cinder-0d32ab38-97ba-401b-b2d5-1da91ea40729-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (7d081f64-b492-48a1-bb8a-40f05c245e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397f80fa-3912-4298-9d73-fcaae68a3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-6c502d29-173b-4fbf-9d12-c965651913b1-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397f80fa-3912-4298-9d73-fcaae68a3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515467369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f881d55-16bc-430d-a2e3-400e347217f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:48Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7182dcad-3715-468d-90da-25ae9479ebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7182dcad-3715-468d-90da-25ae9479ebe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659f26ac-4c49-4a6a-94f7-8c92856de8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659f26ac-4c49-4a6a-94f7-8c92856de8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f881d55-16bc-430d-a2e3-400e347217f8', 'volume_name': 'volume-8f881d55-16bc-430d-a2e3-400e347217f8', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca61e98-a9a8-4364-8c5f-1178dd9b56ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca61e98-a9a8-4364-8c5f-1178dd9b56ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f47a4d5-b9e6-4b32-a6ab-008d65ba75ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Volume 8f881d55-16bc-430d-a2e3-400e347217f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f881d55-16bc-430d-a2e3-400e347217f8', 'volume_size': 1} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515467369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f881d55-16bc-430d-a2e3-400e347217f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:48Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Creating volume 8f881d55-16bc-430d-a2e3-400e347217f8 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:47 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-6c502d29-173b-4fbf-9d12-c965651913b1-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:47 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 1073741824 Sep 28 15:24:47 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-6c502d29-173b-4fbf-9d12-c965651913b1" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:47 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-6c502d29-173b-4fbf-9d12-c965651913b1" acquired by "delete_volume" :: waited 0.026s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb8fb0-c08c-4bbe-a240-a89db48e98f8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:48 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 Sep 28 15:24:48 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:48 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 1073741824" returned: 0 in 0.507s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:48 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 Sep 28 15:24:48 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:48 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1" returned: 0 in 0.454s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:48 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1 Sep 28 15:24:48 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:48 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8" returned: 0 in 0.327s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f47a4d5-b9e6-4b32-a6ab-008d65ba75ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f881d55-16bc-430d-a2e3-400e347217f8', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515f493e-a7dd-4634-9b84-2eeff3f379fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:48 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-6c502d29-173b-4fbf-9d12-c965651913b1" returned: 0 in 0.313s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:48 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Volume volume-8f881d55-16bc-430d-a2e3-400e347217f8 (8f881d55-16bc-430d-a2e3-400e347217f8): created successfully Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515f493e-a7dd-4634-9b84-2eeff3f379fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (7d081f64-b492-48a1-bb8a-40f05c245e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-6c502d29-173b-4fbf-9d12-c965651913b1" released by "delete_volume" :: held 0.869s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:48 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-6ff1389d-3e18-4264-9bce-f4832dfe3483 tempest-ProjectReaderTests-1893651530 None] Created volume successfully. Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Created reservations ['b709a851-59b9-4423-8cfe-6996e484c27f', '79bc11ed-6722-4c4f-a4c4-c3767c55368f', 'b62f386f-cebd-4faf-8dc3-416238ddf2c6', '6970b8c2-ab3e-491c-815a-0f97a838edbf'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:48 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:49 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:49 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:49 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:49 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.252s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:49 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:49 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:24:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-ba4cb6bd-cb71-44d6-b172-019fc77966bc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-6c502d29-173b-4fbf-9d12-c965651913b1-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-8f881d55-16bc-430d-a2e3-400e347217f8-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:49 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-8f881d55-16bc-430d-a2e3-400e347217f8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-quobyte-8f881d55-16bc-430d-a2e3-400e347217f8" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-8f881d55-16bc-430d-a2e3-400e347217f8" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c28af-b88d-4148-afc9-a07326461f70]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:50 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 Sep 28 15:24:50 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:50 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8" returned: 0 in 0.509s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:50 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8 Sep 28 15:24:50 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (47a5321d-5252-40a3-a18f-5501acfba431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40212f3d-c429-4338-940e-acb6a5964d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40212f3d-c429-4338-940e-acb6a5964d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862170145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38461e8e-16e2-4e3c-b7fa-6afd5d12a442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:51Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78f48fc-9314-4ea4-afe2-8da2c1fbb16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78f48fc-9314-4ea4-afe2-8da2c1fbb16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866acc7f-33d6-4a04-9d89-94d131edeec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866acc7f-33d6-4a04-9d89-94d131edeec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38461e8e-16e2-4e3c-b7fa-6afd5d12a442', 'volume_name': 'volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e558c885-38a0-4ac0-add1-a246557e4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e558c885-38a0-4ac0-add1-a246557e4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3e633e-f94c-45d7-9ac6-4e4dd7cc92bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:50 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Volume 38461e8e-16e2-4e3c-b7fa-6afd5d12a442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442', 'volume_size': 1} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862170145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38461e8e-16e2-4e3c-b7fa-6afd5d12a442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:51Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Creating volume 38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:50 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:50 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 1073741824 Sep 28 15:24:50 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:50 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:50 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8f881d55-16bc-430d-a2e3-400e347217f8" returned: 0 in 0.354s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-8f881d55-16bc-430d-a2e3-400e347217f8" released by "delete_volume" :: held 0.927s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Created reservations ['2578f53d-d8c9-412d-9a1b-a9f94709cd43', '0e1089c8-0657-4b21-9c0f-8ae4bae893ed', '36a83795-eb75-4851-80ff-8c4aabf06a3c', '9e0bdaed-3bbe-454d-a388-3ac1a26acba6'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:51 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 1073741824" returned: 0 in 0.589s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 Sep 28 15:24:51 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.305s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Deleted volume successfully. Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-846a2a21-d455-45ef-8e06-91f6f8e15693 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-8f881d55-16bc-430d-a2e3-400e347217f8-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:51 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" returned: 0 in 0.291s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3e633e-f94c-45d7-9ac6-4e4dd7cc92bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dadc49-3e44-47b2-b8d8-9fb45ae9ad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:51 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Volume volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 (38461e8e-16e2-4e3c-b7fa-6afd5d12a442): created successfully Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dadc49-3e44-47b2-b8d8-9fb45ae9ad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:51 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (47a5321d-5252-40a3-a18f-5501acfba431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:51 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-50d903a2-01c5-41b6-adbf-155b5a86c807 tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (faccd3f0-eac5-4052-b9d8-ea546c96eab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1319c0af-4807-4368-84f0-570bf857406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1319c0af-4807-4368-84f0-570bf857406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693950855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb4921-70d4-401f-a69f-1372ed2f1993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:53Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4023093d-159c-4141-86cc-018bfe1ee3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4023093d-159c-4141-86cc-018bfe1ee3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6624081-03ef-4823-b39b-2f95a8e3570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6624081-03ef-4823-b39b-2f95a8e3570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fb4921-70d4-401f-a69f-1372ed2f1993', 'volume_name': 'volume-a6fb4921-70d4-401f-a69f-1372ed2f1993', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a389f660-24f4-46f3-bbb6-1cf7f1cdabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a389f660-24f4-46f3-bbb6-1cf7f1cdabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145b1fc8-273f-4a2b-b8e9-18ce34dd1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:52 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Volume a6fb4921-70d4-401f-a69f-1372ed2f1993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fb4921-70d4-401f-a69f-1372ed2f1993', 'volume_size': 1} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693950855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb4921-70d4-401f-a69f-1372ed2f1993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daee64cf9c3e43c9afdb9f5ebfa0a7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:53Z,use_quota=True,user_id='25db706be4fc416994f92e6b2b875736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Creating volume a6fb4921-70d4-401f-a69f-1372ed2f1993 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:24:52 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:52 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 1073741824 Sep 28 15:24:52 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:52 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:53 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 1073741824" returned: 0 in 0.484s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:53 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 Sep 28 15:24:53 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:53 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993" returned: 0 in 0.290s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.685s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145b1fc8-273f-4a2b-b8e9-18ce34dd1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fb4921-70d4-401f-a69f-1372ed2f1993', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0184f68-4b4a-4525-b0a6-259e67476322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 4ceba911-e15e-47aa-93a7-357c685983e6 of volume 38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:53 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Volume volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 (a6fb4921-70d4-401f-a69f-1372ed2f1993): created successfully Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0184f68-4b4a-4525-b0a6-259e67476322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Flow 'volume_create_manager' (faccd3f0-eac5-4052-b9d8-ea546c96eab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed7930c-6694-4aaf-9858-e1fd65ebc40a]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:53 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:53 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-59c9ddb9-5731-4c75-9ce0-6d78da0525bb tempest-ProjectReaderTests-1893651530 None] Created volume successfully. Sep 28 15:24:53 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 Sep 28 15:24:53 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" returned: 0 in 0.379s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 1G Sep 28 15:24:54 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 1G" returned: 0 in 0.395s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 Sep 28 15:24:54 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6" returned: 0 in 0.322s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 is being set with open permissions: ugo+rw Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 Sep 28 15:24:54 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-a6fb4921-70d4-401f-a69f-1372ed2f1993-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-a6fb4921-70d4-401f-a69f-1372ed2f1993-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "cinder-quobyte-a6fb4921-70d4-401f-a69f-1372ed2f1993" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-a6fb4921-70d4-401f-a69f-1372ed2f1993" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd45a21-233a-4feb-9c46-75168f2ca4d0]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:54 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 Sep 28 15:24:55 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6" returned: 0 in 0.299s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info Sep 28 15:24:55 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993" returned: 0 in 0.366s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993 Sep 28 15:24:55 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info" returned: 0 in 0.271s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info is being set with open permissions: ugo+rw Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info Sep 28 15:24:55 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:55 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-a6fb4921-70d4-401f-a69f-1372ed2f1993" returned: 0 in 0.264s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-quobyte-a6fb4921-70d4-401f-a69f-1372ed2f1993" released by "delete_volume" :: held 0.678s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Created reservations ['ebe3d3d7-1a3b-43a8-b008-3ee8b7ff9fdb', 'f9d1214f-1d4f-4c27-83ee-3adb5670323c', 'd68389dc-e81a-447c-947f-568eb2571f8b', 'd2e6891c-7d09-4b7c-a91a-721cc9074db6'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:55 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.info" returned: 0 in 0.293s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:55 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-32e0cf30-4467-47fe-9240-d44ce04ff87f tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:55 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:55 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:55 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:56 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.300s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:56 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Deleted volume successfully. Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-5de67f4b-96e9-45ee-813f-7b80a01643c9 tempest-ProjectReaderTests-1893651530 None] Lock "cinder-a6fb4921-70d4-401f-a69f-1372ed2f1993-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-4ceba911-e15e-47aa-93a7-357c685983e6-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Lock "cinder-4ceba911-e15e-47aa-93a7-357c685983e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-4ceba911-e15e-47aa-93a7-357c685983e6" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-4ceba911-e15e-47aa-93a7-357c685983e6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 4ceba911-e15e-47aa-93a7-357c685983e6 of volume 38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe176c8-5d90-4384-9d0f-e6be992d3be5]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:56 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 Sep 28 15:24:56 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:56 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6" returned: 0 in 0.416s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a61344-49c2-4a6f-8e43-d74ccc72a077]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:56 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:56 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 Sep 28 15:24:56 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:57 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" returned: 0 in 0.430s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:57 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 Sep 28 15:24:57 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:57 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6" returned: 0 in 0.386s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:57 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6 Sep 28 15:24:57 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:57 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442.4ceba911-e15e-47aa-93a7-357c685983e6" returned: 0 in 0.280s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-4ceba911-e15e-47aa-93a7-357c685983e6" released by "_delete_snapshot" :: held 1.645s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" released by "delete_snapshot" :: held 1.677s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:57 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Created reservations ['f9ac9227-0a12-4f4b-b320-869697594edd', 'c673ba6a-b0f4-4de1-99ef-dc9fdc6cafc6', '0860105b-2e63-4082-b93e-d3aa34a5baaa', '0f654a1b-b527-4e18-925b-445f82cfea95'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:58 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-bcaf50c1-93e4-40d2-8885-38411f66416d tempest-ProjectMemberTests-1538406198 None] Lock "cinder-4ceba911-e15e-47aa-93a7-357c685983e6-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-38461e8e-16e2-4e3c-b7fa-6afd5d12a442-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Lock "cinder-38461e8e-16e2-4e3c-b7fa-6afd5d12a442-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" acquired by "delete_volume" :: waited 0.017s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0741d8c-7dbc-4ce6-9fbf-d4cd1eadc149]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:58 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 Sep 28 15:24:58 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:58 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" returned: 0 in 0.369s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:58 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:58 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442 Sep 28 15:24:58 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:59 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" returned: 0 in 0.264s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-38461e8e-16e2-4e3c-b7fa-6afd5d12a442" released by "delete_volume" :: held 0.702s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Created reservations ['874dd5f9-4378-4bab-8ffa-d855334b310f', '481e5436-0d63-46bf-91c4-d2ce59249afc', 'af10ff25-8b18-4e9b-8e5f-fce130f152ce', '8fb0ed8e-e72c-4567-9fd6-00c5163f286e'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:59 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:24:59 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:59 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.259s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:59 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-aa6d13a7-2b64-4b0b-a0e5-b1ab39faae1c tempest-ProjectMemberTests-1538406198 None] Lock "cinder-38461e8e-16e2-4e3c-b7fa-6afd5d12a442-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (24d1c94b-74da-4075-9369-097a119539aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e6c54e-bba0-44a7-bb85-080ecf0bfd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e6c54e-bba0-44a7-bb85-080ecf0bfd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1098010968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d63013-c4f4-4c86-bb05-40e2a3c1f849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:00Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4f16df-21c3-4355-8f6d-0794ae5f8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4f16df-21c3-4355-8f6d-0794ae5f8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:59 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f248315f-771f-4381-a523-5c7a7deb781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f248315f-771f-4381-a523-5c7a7deb781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d63013-c4f4-4c86-bb05-40e2a3c1f849', 'volume_name': 'volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ffb06a-face-4075-ad11-6606a3082bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ffb06a-face-4075-ad11-6606a3082bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f202c8f7-9575-4ccc-b00f-7d837f856702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Volume 31d63013-c4f4-4c86-bb05-40e2a3c1f849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849', 'volume_size': 1} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1098010968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d63013-c4f4-4c86-bb05-40e2a3c1f849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:00Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Creating volume 31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:25:00 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:00 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 1073741824 Sep 28 15:25:00 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:00 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 1073741824" returned: 0 in 0.444s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:00 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 Sep 28 15:25:00 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:00 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849" returned: 0 in 0.248s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f202c8f7-9575-4ccc-b00f-7d837f856702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e73403-4f4f-4a6c-9a39-f99b0037c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:00 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Volume volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 (31d63013-c4f4-4c86-bb05-40e2a3c1f849): created successfully Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e73403-4f4f-4a6c-9a39-f99b0037c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:00 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (24d1c94b-74da-4075-9369-097a119539aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:00 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-3b637000-f722-4b79-8dfb-6cd01ebd1dd6 tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 9eff3f02-de02-4765-b028-1dcf6302f965 of volume 31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e20ec-d488-4d65-b27b-d6748b46ca06]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:01 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 Sep 28 15:25:01 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:01 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849" returned: 0 in 0.384s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:01 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:01 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 1G Sep 28 15:25:01 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:01 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 1G" returned: 0 in 0.437s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:02 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 Sep 28 15:25:02 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:02 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965" returned: 0 in 0.312s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:02 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 is being set with open permissions: ugo+rw Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:02 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 Sep 28 15:25:02 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:02 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965" returned: 0 in 0.248s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:02 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info Sep 28 15:25:02 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:02 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info" returned: 0 in 0.278s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:02 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info is being set with open permissions: ugo+rw Sep 28 15:25:02 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:02 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info Sep 28 15:25:02 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:03 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.info" returned: 0 in 0.259s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:03 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:03 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-dbc3fe5d-fc54-4dd9-aacf-0bb45c21d2e7 tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-9eff3f02-de02-4765-b028-1dcf6302f965-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-9eff3f02-de02-4765-b028-1dcf6302f965-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-31d63013-c4f4-4c86-bb05-40e2a3c1f849" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-31d63013-c4f4-4c86-bb05-40e2a3c1f849" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-9eff3f02-de02-4765-b028-1dcf6302f965" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-9eff3f02-de02-4765-b028-1dcf6302f965" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 9eff3f02-de02-4765-b028-1dcf6302f965 of volume 31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[34baa1fb-be46-425e-b255-f52a719a86e3]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:04 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 Sep 28 15:25:04 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:04 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965" returned: 0 in 0.363s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da02788-0dda-43eb-8011-220895a57481]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:04 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:04 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 Sep 28 15:25:04 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:05 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849" returned: 0 in 0.414s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:05 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 Sep 28 15:25:05 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:05 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965" returned: 0 in 0.416s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:05 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965 Sep 28 15:25:05 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:05 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:05 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849.9eff3f02-de02-4765-b028-1dcf6302f965" returned: 0 in 0.320s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:05 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-9eff3f02-de02-4765-b028-1dcf6302f965" released by "_delete_snapshot" :: held 1.618s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-31d63013-c4f4-4c86-bb05-40e2a3c1f849" released by "delete_snapshot" :: held 1.642s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Created reservations ['76b89ad1-4bce-48c1-baa2-1fa6c5801107', '3a25f6ba-a883-4a06-a945-a668de172f8d', '795a8379-03c1-4a47-957a-26a8752544ed', '341be154-7b74-47fb-bb33-d88253673ea7'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:06 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-22f71ec4-f297-4462-9f5c-746a87cc6edc tempest-ProjectMemberTests-1538406198 None] Lock "cinder-9eff3f02-de02-4765-b028-1dcf6302f965-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-31d63013-c4f4-4c86-bb05-40e2a3c1f849-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Lock "cinder-31d63013-c4f4-4c86-bb05-40e2a3c1f849-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-31d63013-c4f4-4c86-bb05-40e2a3c1f849" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-31d63013-c4f4-4c86-bb05-40e2a3c1f849" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[d977e236-26b9-484d-9b71-73aa9f5facff]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:06 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:06 devstack sudo[109963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 Sep 28 15:25:06 devstack sudo[109963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:07 devstack sudo[109963]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849" returned: 0 in 0.378s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:07 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849 Sep 28 15:25:07 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:07 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-31d63013-c4f4-4c86-bb05-40e2a3c1f849" returned: 0 in 0.289s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-31d63013-c4f4-4c86-bb05-40e2a3c1f849" released by "delete_volume" :: held 0.736s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Created reservations ['26415892-d756-4869-a02e-9c7564425296', '7c95e62c-b2d8-43d2-b340-509484d414f8', 'b3081e46-403c-481a-a3a2-82e1aaa1d8b1', 'c7bad17a-2da5-4775-a796-870cb93d34c2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:07 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:25:07 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:07 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.298s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:07 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:25:07 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-42bbd28d-464b-4c3b-b4b8-853dc68a0e5f tempest-ProjectMemberTests-1538406198 None] Lock "cinder-31d63013-c4f4-4c86-bb05-40e2a3c1f849-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (ce3e20b8-97f0-4bdf-aac9-b23a932eac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b261ae-8f4e-4ec6-a779-bfacb7c187ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b261ae-8f4e-4ec6-a779-bfacb7c187ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1767050816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7096e0-c2f6-4c21-85eb-1bf47f83cc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:08Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1dd8d97-00f1-44d7-8711-04cfef758bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1dd8d97-00f1-44d7-8711-04cfef758bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f21bea-6406-4398-a0ef-9f2187c15127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f21bea-6406-4398-a0ef-9f2187c15127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7096e0-c2f6-4c21-85eb-1bf47f83cc19', 'volume_name': 'volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d89aef-b174-4a2a-ab1d-bc7365d5a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d89aef-b174-4a2a-ab1d-bc7365d5a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0dc643-75e8-4135-bedd-830be43ac9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:08 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Volume 3b7096e0-c2f6-4c21-85eb-1bf47f83cc19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19', 'volume_size': 1} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1767050816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7096e0-c2f6-4c21-85eb-1bf47f83cc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9bf37bfc84d21b291eedcad0b5509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:08Z,use_quota=True,user_id='be3b6e83df654038b23285ab47e6d5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Creating volume 3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:25:08 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:08 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 1073741824 Sep 28 15:25:08 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:08 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 1073741824" returned: 0 in 0.429s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:08 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 Sep 28 15:25:08 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:08 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" returned: 0 in 0.255s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:25:08 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0dc643-75e8-4135-bedd-830be43ac9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95873bab-591e-4443-90a6-3bddd059fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:09 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Volume volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 (3b7096e0-c2f6-4c21-85eb-1bf47f83cc19): created successfully Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95873bab-591e-4443-90a6-3bddd059fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Flow 'volume_create_manager' (ce3e20b8-97f0-4bdf-aac9-b23a932eac44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:09 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-599080fe-4629-4c77-82e7-373702504b20 tempest-ProjectMemberTests-1538406198 None] Created volume successfully. Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Creating offline snapshot 896effab-8f7e-4ad4-9f26-85ac966083a5 of volume 3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207a9e4-7552-4d63-8b5d-39439a5d30b8]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:09 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 Sep 28 15:25:09 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:09 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" returned: 0 in 0.374s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:09 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 1G {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:09 devstack sudo[109987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 1G Sep 28 15:25:09 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:10 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 1G" returned: 0 in 0.415s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:10 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 Sep 28 15:25:10 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:10 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 -F qcow2 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5" returned: 0 in 0.315s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:10 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 is being set with open permissions: ugo+rw Sep 28 15:25:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:10 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 Sep 28 15:25:10 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:10 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5" returned: 0 in 0.291s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:10 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:10 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info Sep 28 15:25:10 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:11 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info" returned: 0 in 0.272s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:11 devstack cinder-volume[86888]: WARNING cinder.volume.drivers.remotefs [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info is being set with open permissions: ugo+rw Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:11 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info Sep 28 15:25:11 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:11 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.info" returned: 0 in 0.232s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:11 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-c8397c8e-301d-4a81-8a74-839235594929 tempest-ProjectMemberTests-1538406198 None] Create snapshot completed successfully Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-896effab-8f7e-4ad4-9f26-85ac966083a5-delete_snapshot" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-896effab-8f7e-4ad4-9f26-85ac966083a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" by "delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-896effab-8f7e-4ad4-9f26-85ac966083a5" by "_delete_snapshot" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-896effab-8f7e-4ad4-9f26-85ac966083a5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Deleting offline snapshot 896effab-8f7e-4ad4-9f26-85ac966083a5 of volume 3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] snapshot_file for this snap is: volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 {{(pid=86888) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[29391e4e-ffc8-47a0-ac63-386caed7e67c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:11 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:11 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 Sep 28 15:25:11 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:12 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5" returned: 0 in 0.356s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86888) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ad53bd-4a55-4a04-b9eb-c8ccfd3bde56]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:12 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 Sep 28 15:25:12 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:12 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" returned: 0 in 0.366s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:12 devstack sudo[110138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 Sep 28 15:25:12 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:12 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5" returned: 0 in 0.345s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:12 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:12 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5 Sep 28 15:25:12 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:12 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19.896effab-8f7e-4ad4-9f26-85ac966083a5" returned: 0 in 0.241s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-896effab-8f7e-4ad4-9f26-85ac966083a5" released by "_delete_snapshot" :: held 1.405s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" released by "delete_snapshot" :: held 1.426s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Created reservations ['c6c71cf4-15b8-4968-9757-0d62eb88518a', '5b83c741-051e-4a18-8f73-c608aacb2cc1', '1afdf433-7c01-4712-81b3-90c83d3d2c0f', '06206519-eb6a-4844-8e3b-57cc760c5cf8'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:13 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Delete snapshot completed successfully. Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-a78c5b1b-51db-46ef-aab0-9d9ba9e061c2 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-896effab-8f7e-4ad4-9f26-85ac966083a5-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "cinder-quobyte-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" acquired by "delete_volume" :: waited 0.014s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819c9ae-def6-4ef2-a316-465f3733210c]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:13 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:13 devstack sudo[110146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 Sep 28 15:25:13 devstack sudo[110146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:14 devstack sudo[110146]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" returned: 0 in 0.386s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:14 devstack sudo[110151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19 Sep 28 15:25:14 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:14 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" returned: 0 in 0.248s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-quobyte-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19" released by "delete_volume" :: held 0.695s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Created reservations ['2bf198d6-f9e8-4338-8250-229d1dafc1ad', '0c85c9ac-9de8-4f1c-9cba-a6bd5603bbbf', 'e2cb1fbf-c3c6-4b29-8105-a879494c88bf', 'c5422e8f-62b8-4bb9-a263-15cd38774de2'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:14 devstack sudo[110154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:25:14 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:14 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.256s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:14 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Deleted volume successfully. Sep 28 15:25:14 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-fdf7a663-8477-4dc3-8d79-93410bf3cb16 tempest-ProjectMemberTests-1538406198 None] Lock "cinder-3b7096e0-c2f6-4c21-85eb-1bf47f83cc19-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:24 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=125,cinder:INSERT=51,cinder:UPDATE=173,cinder:DELETE=15 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:24 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=136,cinder:INSERT=44,cinder:UPDATE=186,cinder:DELETE=14 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Flow 'volume_create_manager' (4c95d8bc-2a99-47c7-b637-c479a28977a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa67d4-65c9-4f1c-a26f-98e629ebbc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa67d4-65c9-4f1c-a26f-98e629ebbc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779631782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9f310b-0231-4bdb-b157-cd04aecbdd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8973165066f74fa8bff4e0dd5265fa65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:26Z,use_quota=True,user_id='f2285f9f04104a80bfc7c89a1330ebc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101dc9d4-334d-4c7b-aee9-6ac6218c5389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101dc9d4-334d-4c7b-aee9-6ac6218c5389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c827408-58a6-4923-b72f-0eedbca9cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c827408-58a6-4923-b72f-0eedbca9cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9f310b-0231-4bdb-b157-cd04aecbdd98', 'volume_name': 'volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f934d456-5934-4bbb-9701-18d132771432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f934d456-5934-4bbb-9701-18d132771432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fb2c98-9e7f-4d5d-b58e-e970d7c4c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:26 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Volume 8e9f310b-0231-4bdb-b157-cd04aecbdd98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98', 'volume_size': 1} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779631782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9f310b-0231-4bdb-b157-cd04aecbdd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8973165066f74fa8bff4e0dd5265fa65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:26Z,use_quota=True,user_id='f2285f9f04104a80bfc7c89a1330ebc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Creating volume 8e9f310b-0231-4bdb-b157-cd04aecbdd98 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:25:26 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:26 devstack sudo[110159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 1073741824 Sep 28 15:25:26 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:26 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 1073741824" returned: 0 in 0.426s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:26 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:26 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 Sep 28 15:25:26 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:27 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98" returned: 0 in 0.249s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fb2c98-9e7f-4d5d-b58e-e970d7c4c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6998d3bf-96fd-4513-ae28-841c2b5b2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:27 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Volume volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 (8e9f310b-0231-4bdb-b157-cd04aecbdd98): created successfully Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6998d3bf-96fd-4513-ae28-841c2b5b2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Flow 'volume_create_manager' (4c95d8bc-2a99-47c7-b637-c479a28977a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:27 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-583799c9-ca33-4aa5-8c39-9a8989cad376 tempest-ProjectReaderTests-2825229 None] Created volume successfully. Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Acquiring lock "cinder-8e9f310b-0231-4bdb-b157-cd04aecbdd98-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Lock "cinder-8e9f310b-0231-4bdb-b157-cd04aecbdd98-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Acquiring lock "cinder-quobyte-8e9f310b-0231-4bdb-b157-cd04aecbdd98" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Lock "cinder-quobyte-8e9f310b-0231-4bdb-b157-cd04aecbdd98" acquired by "delete_volume" :: waited 0.018s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf041164-fa15-47a9-80cd-412f71bed995]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:27 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:27 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 Sep 28 15:25:27 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:28 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98" returned: 0 in 0.393s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:28 devstack sudo[110172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98 Sep 28 15:25:28 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:28 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-8e9f310b-0231-4bdb-b157-cd04aecbdd98" returned: 0 in 0.241s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Lock "cinder-quobyte-8e9f310b-0231-4bdb-b157-cd04aecbdd98" released by "delete_volume" :: held 0.679s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Created reservations ['70a9828f-0266-452c-bdbd-55e10b5ade8a', '3850b90c-8943-4251-9d2e-b99b6289db9e', 'ea3a5360-447f-4bf1-a727-119cb683988f', '4963f2b6-8f83-4027-94db-a4bb15e20b5c'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:28 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:25:28 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:28 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.261s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:28 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Deleted volume successfully. Sep 28 15:25:28 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-da675721-0912-4de3-bc37-4c528b57cedc tempest-ProjectReaderTests-2825229 None] Lock "cinder-8e9f310b-0231-4bdb-b157-cd04aecbdd98-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.flows.manager.create_volume [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86888) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Flow 'volume_create_manager' (a1593931-1906-41c2-b603-58e5789e43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174a6d01-8ece-4d26-b6ba-337425075303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174a6d01-8ece-4d26-b6ba-337425075303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875245013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303e5a12-c2de-4f2e-aed4-dc672ff46202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8973165066f74fa8bff4e0dd5265fa65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:29Z,use_quota=True,user_id='f2285f9f04104a80bfc7c89a1330ebc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028f9403-dca4-44f3-aa17-b29675f13a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028f9403-dca4-44f3-aa17-b29675f13a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5922ecdf-4987-4073-8e37-f411b1948503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5922ecdf-4987-4073-8e37-f411b1948503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303e5a12-c2de-4f2e-aed4-dc672ff46202', 'volume_name': 'volume-303e5a12-c2de-4f2e-aed4-dc672ff46202', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b81cb62-ffac-4634-b77a-3576920e12c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b81cb62-ffac-4634-b77a-3576920e12c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdde1ef-480a-4147-972a-ca8329532a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:29 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Volume 303e5a12-c2de-4f2e-aed4-dc672ff46202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303e5a12-c2de-4f2e-aed4-dc672ff46202', 'volume_size': 1} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875245013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303e5a12-c2de-4f2e-aed4-dc672ff46202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8973165066f74fa8bff4e0dd5265fa65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:29Z,use_quota=True,user_id='f2285f9f04104a80bfc7c89a1330ebc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d40556a-2a08-4490-bf8d-be24a9708d14),volume_type_id=2d40556a-2a08-4490-bf8d-be24a9708d14)}" {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.remotefs [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Creating volume 303e5a12-c2de-4f2e-aed4-dc672ff46202 {{(pid=86888) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Selected osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b as target Quobyte volume. {{(pid=86888) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 28 15:25:29 devstack cinder-volume[86888]: INFO cinder.volume.drivers.remotefs [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] casted to osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 1073741824 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:29 devstack sudo[110178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 1073741824 Sep 28 15:25:29 devstack sudo[110178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:29 devstack sudo[110178]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 1073741824" returned: 0 in 0.400s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:29 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:29 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 Sep 28 15:25:29 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:30 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202" returned: 0 in 0.233s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'} {{(pid=86888) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdde1ef-480a-4147-972a-ca8329532a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303e5a12-c2de-4f2e-aed4-dc672ff46202', 'volume_size': 1}' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab7777e-d396-43d4-9e70-1a5947fb84f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:30 devstack cinder-volume[86888]: INFO cinder.volume.flows.manager.create_volume [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Volume volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 (303e5a12-c2de-4f2e-aed4-dc672ff46202): created successfully Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab7777e-d396-43d4-9e70-1a5947fb84f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86888) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Flow 'volume_create_manager' (a1593931-1906-41c2-b603-58e5789e43c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86888) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:30 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-903331fb-084b-4e32-806f-fb7bb6c5e3db tempest-ProjectReaderTests-2825229 None] Created volume successfully. Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Acquiring lock "cinder-303e5a12-c2de-4f2e-aed4-dc672ff46202-delete_volume" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Lock "cinder-303e5a12-c2de-4f2e-aed4-dc672ff46202-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Acquiring lock "cinder-quobyte-303e5a12-c2de-4f2e-aed4-dc672ff46202" by "delete_volume" {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Lock "cinder-quobyte-303e5a12-c2de-4f2e-aed4-dc672ff46202" acquired by "delete_volume" :: waited 0.014s {{(pid=86888) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e40b88b-d5d2-43e1-9d28-0d49efd955d9]: (4, 'qcow2') {{(pid=88500) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:30 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 Sep 28 15:25:30 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:30 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202" returned: 0 in 0.364s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:30 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:30 devstack sudo[110192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202 Sep 28 15:25:30 devstack sudo[110192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:30 devstack sudo[110192]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327/volume-303e5a12-c2de-4f2e-aed4-dc672ff46202" returned: 0 in 0.258s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Lock "cinder-quobyte-303e5a12-c2de-4f2e-aed4-dc672ff46202" released by "delete_volume" :: held 0.662s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG cinder.quota [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Created reservations ['8d17d436-7b58-455b-a120-517bec2c3f58', 'a0ad41ef-1699-4f1c-adbb-9a180f6ca8a7', '825a508e-9cce-4069-b499-ae8f0d18f567', '07d6fe34-e0db-4410-bd5e-ddc5fcefc159'] {{(pid=86888) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:31 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:25:31 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:31 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.259s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:31 devstack cinder-volume[86888]: INFO cinder.volume.manager [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Deleted volume successfully. Sep 28 15:25:31 devstack cinder-volume[86888]: DEBUG cinder.coordination [None req-30d8c201-4fa3-465d-99ec-f567f896a5a1 tempest-ProjectReaderTests-2825229 None] Lock "cinder-303e5a12-c2de-4f2e-aed4-dc672ff46202-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86888) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b': None} {{(pid=86888) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG cinder.volume.drivers.quobyte [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d26ccc7-8584-46d6-b0ba-c67b5c06591b'] {{(pid=86888) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.lockutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86888) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:40 devstack sudo[110203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327 Sep 28 15:25:40 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:40 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_concurrency.processutils [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f0a08d5053d0352ca1cb8264be398327" returned: 0 in 0.240s {{(pid=86888) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG cinder.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Notifying Schedulers of capabilities ... {{(pid=86888) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG oslo_service.periodic_task [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] Running periodic task VolumeManager._thread_info {{(pid=86888) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread count: 29 {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:25:40 devstack cinder-volume[86888]: DEBUG cinder.volume.manager [None req-690e1b99-2667-4c47-b2ae-ea7f34e65d00 None None] thread info: [<_MainThread(MainThread, started 129584391905408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86888) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:25:41 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=13,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:41 devstack cinder-volume[86888]: DEBUG dbcounter [-] [86888] Writing DB stats cinder:SELECT=15,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}